Search results

  1. Jim Boy

    Xenforo on Amazon EC2

    XF doesn't support db-slave for read only. I'm still not sold on aurora being a better solution than rds either
  2. Jim Boy

    Upcoming changes for GDPR compliance in XF1 and XF2

    It's their whole history, public or not. Their is a reasonableness to the GDPR, and you are exempt if you dont offer services to the EU, regardless of whether you have some EU members or not. Ultimately you can get fined massively - 20,000,000 euros is the starting point. If XenForo wrrants...
  3. Jim Boy

    Upcoming changes for GDPR compliance in XF1 and XF2

    The content itself doesn't need to contain personally identifiable, it just needs to be in correlation with data that is correlateable. A username is just that - it doesn't matter whether the the username is Slavik or "deleted user 2270". The fact that you have uniquely identified and grouped...
  4. Jim Boy

    Upcoming changes for GDPR compliance in XF1 and XF2

    I dont believe the erasure method is sufficient - changing the username is just that, changing the username. And the right to be forgotten doesn't necessarily mean they want to leave the forum. We get members who want their history to be removed for personal reasons, such as having said stuff in...
  5. Jim Boy

    Xenforo on Amazon EC2

    Yes nginx caching is fine for things like javascript etc, although we offload much of this to S3. The caching I was referring to was mainly around session management etc. For example the settings in our config.php are $config['cache']['enabled'] = true; $config['cache']['frontend'] = 'Core'...
  6. Jim Boy

    Xenforo on Amazon EC2

    If you had only 20GB on fifth, its no wonder your performance was woeful then - you get 3 iops per GB so you effectively had only 60 iops - given your customer base, it was never going to cut it. Focus only on the performance since you allocated the extra space. I run possibly the single...
  7. Jim Boy

    Xenforo on Amazon EC2

    It is a little hard to tell with those graphs - over such a long period cloudwatch will tend to flatten things and round off the peaks. It is better to drill down to the critical times. I'd be a bit concerend about that IOPS peak on the 5th. A couple of things though - with 200GB of disk space...
  8. Jim Boy

    Xenforo on Amazon EC2

    For the web servers you really should use c4 or c5 instances IMO. With RDS - I/O is especially critical, you may want to be using IOPs backed storage. Check your I/O stats on the RDS instance, you probably have a bottle neck here Get autoscaling going for your ec2 instances. However it does...
  9. Jim Boy

    Xenforo on Amazon EC2 with Aurora? ERROR 1118 (42000) while importing vBulletin database!

    I have done a bit of a trial on Aurora with XF and did not run into any problems, and that was with a pretty substantial DB (40 million + posts). Having said that I decided not to go with it as the costing was questionable Aurora is NOT better than MariaDb/MySQL in every scenario. We found that...
  10. Jim Boy

    Amazon Polly For Site Help Videos

    Why have a button?, why not just say 'read post', you could build a navigation system around Lex and search for stuff as well- XF could make money off it by pushing the code as a Saas offering
  11. Jim Boy

    Implemented Enhanced Search configurable http client

    and while we are it, include option for username/password
  12. Jim Boy

    Does Elastic Search find synonyms and paraphrasing like Google?

    The file should be located relative to the config file. Normally that would be /etc/elasticsearch/elasticsearch.yml, eg /etc/elasticsearch/analysis/synonym.txt I dont see why it wouldn't work with Enhanced Search as the change is all on the elasticsearch side
  13. Jim Boy

    Fast reindex for large site

    Hey @Xon, thanks for the reply _id gets assigned by using "document_id" in the elasticsearch output - it is illegal to assign it explicitly to '_id' in a mutate statement I dont think you are reading that right - The 'if "" in [title]' condiition really only says does this condition exist and...
  14. Jim Boy

    Amazon Polly For Site Help Videos

    If you really want to amp it up, you could develop a plugin that utilises Polly and Lex to turn XenForo into a site that is entirely audio orientated
  15. Jim Boy

    Fast reindex for large site

    OK - I worked out why it starting crapping out at 20,000,000 posts - overlooked that I had set this box up as as an ec2 t2.medium, and after around 20,000,000 it ran out of cpu credits. Before that it was running very slowly though So as an alternative I am trialling logstash to get...
  16. Jim Boy

    Fast reindex for large site

    Not seeing any errors there - right now the script is consuming a lot of cpu but not actually submitting anything to elasticsearcgh - which is getting submissions from normal Xenforo traffic. appears to be spinning its wheels
  17. Jim Boy

    Fast reindex for large site

    Like what? On the discussion thread for your plugin you say that it isn''t really much faster than the standard routine - its just that it can be set to run in the background. How do I go about debuging this, as it is, it has completely stalled at around 20,000,000 posts
  18. Jim Boy

    Fast reindex for large site

    Alas it aint so fast - still looking at several days - seems bound on CPU rather than database or elasticsearch. Would be ok if it multi-threaded, but as it is I can't scale this out :(
  19. Jim Boy

    Fast reindex for large site

    That looks perfect ! Gotta love a command line tool
  20. Jim Boy

    Fast reindex for large site

    Following an upgrade of elasticsearch to 5.4 (the index was originally created as a 0.90) and putting in @Xon 's excellent plugins I have to do a full re-index. Anyone got any alternative methods for doing a fast re-index? With 50 million posts the normal admin system is impossibly slow - and...
Top