1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Unusually high resource usage?

Discussion in 'Server Configuration and Hosting' started by Notturno, Apr 16, 2014.

  1. Notturno

    Notturno Member

    So, I just recently had my database access with Arvixe disabled - apparently XenForo is using up too many resources? I have barely anyone using my site, and I have absolutely no idea what's causing the load issues.

    I was given this text file as evidence, but I'm not entirely sure what to conclude from it. I really have no idea where to begin looking at what's causing the resource abuse.

    I'm running XenForo 1.5, XenPorta, XenMedio, XenAtendo, and Simple Forms, if that helps.

    Any ideas or information would be a huge help.
     
  2. Brogan

    Brogan XenForo Moderator Staff Member

    The first step is to disable add-ons and test again.
    Are your tables correct, as far as InnoDB, MyISAM and Memory are concerned?

    The next thing to look at is server tuning/configuration.

    If none of that helps, consider moving hosts.
     
  3. Digital Doctor

    Digital Doctor Well-Known Member

    Maybe this is a clue ?
    Waiting for table level lock| INSERT INTO `xf_session` (`session_id`, `session_data`, `expiry_date`) VALUES (?, ?, ?)|

    Any ideas in this search ? or this thread ?
     
    Last edited: Apr 16, 2014
  4. Notturno

    Notturno Member

    Well at this point, they disabled access to my database, I wouldn't even be able to try disabling my add-ons to fix it. I guess I'm going to have to try getting my access back to see what's going on.

    As for the databases, the weird thing is I haven't changed anything - I've been with them for nine months and this has just recently became an issue.
     
  5. Brogan

    Brogan XenForo Moderator Staff Member

    If they have disabled access then there's nothing you can do to investigate and attempt to solve the issue.

    Therefore my final point would appear to be the best course of action.
     
  6. MattW

    MattW Well-Known Member

    Looks like you are getting hit quite hard by bots:

    Code:
    Incoming Connections:
    107.158.229.204  astralreign.com                  /members/
    107.181.70.166   astralreign.com                  /members//RK=0/RS=TiY593xCYqHp_8un06DGij0Z2g8-
    107.181.70.167   astralreign.com                  /members//RK=0/RS=TiY593xCYqHp_8un06DGij0Z2g8-
    108.53.148.252   astralreign.com                  /cron.php?1397640324
    108.53.148.252   astralreign.com                  /pages/about/
    108.61.136.34    astralreign.com                  /help/
    108.61.136.34    astralreign.com                  /help/
    108.61.136.34    astralreign.com                  /help/bb-codes
    108.61.136.34    astralreign.com                  /help/bb-codes
    113.57.252.104   astralreign.com                  /members/
    116.112.66.102   astralreign.com                  /search/
    117.74.121.218   astralreign.com                  /members/
    119.252.160.34   astralreign.com                  /search/
    138.91.92.148    astralreign.com                  /members/annmarieh.188/
    157.55.33.79     astralreign.com                  /forms/
    157.55.33.79     astralreign.com                  /forms/
    157.55.33.79     astralreign.com                  /forms/
    157.55.33.79     astralreign.com                  /link-forums/about.40/
    157.55.33.79     astralreign.com                  /link-forums/about.40/
    157.55.33.79     astralreign.com                  /link-forums/about.40/
    157.55.35.40     astralreign.com                  /events/weekly/44.2012/members/shyguyspirit.11/
    157.55.35.40     astralreign.com                  /index/index.rss
    157.55.35.40     astralreign.com                  /index/index.rss
    157.55.35.40     astralreign.com                  /index/index.rss
    157.55.35.40     astralreign.com                  /members/artie.281/
    157.55.35.40     astralreign.com                  /members/artie.281/
    157.55.35.40     astralreign.com                  /members/artie.281/
    157.55.35.40     astralreign.com                  /pages/faq/
    157.55.35.40     astralreign.com                  /pages/faq/
    157.55.35.40     astralreign.com                  /pages/faq/
    162.244.11.7     astralreign.com                  /help/bb-codes
    162.244.11.7     astralreign.com                  /help/bb-codes
    173.0.57.29      astralreign.com                  /help/bb-codes
    173.232.105.113  astralreign.com                  /members//RK=0/RS=7M1d2M4ZvFeMY6fqo1xVz2OMocY-
    180.180.118.253  astralreign.com                  /
    183.207.228.14   astralreign.com                  /members/
    183.60.213.38    astralreign.com                  /pages/teamspeak/help/smilies
    183.60.214.126   astralreign.com                  /pages/teamspeak/help/
    184.105.235.40   astralreign.com                  /members//RS=^ADACVQ7VPprjmlNJpCRhGI7QcEW3jY-
    184.154.7.28     astralreign.com                  /help/bb-codes
    188.240.129.76   astralreign.com                  /help/bb-codes
    188.240.129.76   astralreign.com                  /help/bb-codes
    198.175.124.97   astralreign.com                  /members/
    198.20.81.37     astralreign.com                  /members//RK=0/RS=Mfsf_4HLoPZTZuqDIv4mlHSetx0-
    198.23.248.15    astralreign.com                  /members/
    198.50.235.17    astralreign.com                  /members/vyxxi.2/
    198.50.240.80    astralreign.com                  /members/
    198.50.253.80    astralreign.com                  /members/
    198.50.253.80    astralreign.com                  /members/
    198.50.253.80    astralreign.com                  /online/
    198.50.253.80    astralreign.com                  /online/
    202.43.115.50    astralreign.com                  /members/meracle-starr.284//RK=0/RS=fQAWkuFsdwpI1upqH6uRKuK
    211.139.149.71   astralreign.com                  /
    212.13.102.42    astralreign.com                  /members/meracle-starr.284//RK=0/RS=fQAWkuFsdwpI1upqH6uRKuK
    213.192.26.6     astralreign.com                  /
    23.105.54.16     astralreign.com                  /recent-activity/
    23.231.7.47      astralreign.com                  /members/anitalack.124/
    23.252.107.117   astralreign.com                  /forms/?page=0
    23.254.134.187   astralreign.com                  /help/bb-codes
    23.254.134.187   astralreign.com                  /help/bb-codes
    23.81.206.182    astralreign.com                  /
    23.81.206.182    astralreign.com                  /members/
    31.7.56.170      astralreign.com                  /
    31.7.56.170      astralreign.com                  /members/
    37.187.79.141    astralreign.com                  /members/
    46.4.24.148      astralreign.com                  /members/
    46.4.24.148      astralreign.com                  /members//RK=0/RS=2rz9RdWmlfhEGDpXBBwTiDg1Wxk-
    46.4.24.148      astralreign.com                  /online/
    5.153.237.229    astralreign.com                  /
    59.58.189.146    astralreign.com                  /threads/astral-reign-starbound-server.293
    62.210.113.18    astralreign.com                  /help/bb-codes
    62.210.113.18    astralreign.com                  /members/annmarieh.188/
    64.14.41.15      astralreign.com                  /members/
    66.249.70.225    astralreign.com                  /members/bob-saget.270/recent-activity
    66.249.73.235    astralreign.com                  /events/monthly/10.1994/
    66.249.73.235    astralreign.com                  /events/monthly/10.1994/
    66.249.73.235    astralreign.com                  /events/monthly/10.1994/
    66.249.73.235    astralreign.com                  /events/monthly/2.1995/
    66.249.73.235    astralreign.com                  /events/monthly/2.1995/
    66.249.73.235    astralreign.com                  /events/monthly/3.2038/
    66.249.73.235    astralreign.com                  /events/monthly/3.2038/
    66.249.73.235    astralreign.com                  /events/monthly/7.1994/
    66.249.73.235    astralreign.com                  /events/monthly/7.1994/
    66.249.73.235    astralreign.com                  /events/monthly/7.1994/
    66.249.73.235    astralreign.com                  /events/monthly/8.1994/
    66.249.73.235    astralreign.com                  /events/monthly/8.1994/
    66.249.73.235    astralreign.com                  /events/monthly/8.1994/
    66.249.73.235    astralreign.com                  /events/monthly/9.1994/
    66.249.73.235    astralreign.com                  /events/monthly/9.1994/
    66.249.73.235    astralreign.com                  /events/monthly/9.1994/
    66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
    66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
    66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
    66.249.73.235    astralreign.com                  /members/
    66.249.73.235    astralreign.com                  /members/
    66.249.73.235    astralreign.com                  /members/
    66.249.73.235    astralreign.com                  /members/jcvd.228/
    66.249.73.235    astralreign.com                  /members/jcvd.228/
    66.249.73.235    astralreign.com                  /members/jcvd.228/
    66.249.73.235    astralreign.com                  /members/notturno.1/
    66.249.73.235    astralreign.com                  /members/notturno.1/
    66.249.73.235    astralreign.com                  /members/notturno.1/
    66.249.73.235    astralreign.com                  /posts/1109/
    66.249.73.235    astralreign.com                  /posts/1109/
    66.249.73.235    astralreign.com                  /posts/1109/
    66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
    66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
    66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
    66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
    66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
    66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
    66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
    66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
    66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
    66.249.76.170    astralreign.com                  /events/weekly/11.2014/
    66.249.76.181    astralreign.com                  /members/bob-saget.270/recent-content
    66.249.76.181    astralreign.com                  /members/kaburma.259/recent-activity
    66.69.218.38     astralreign.com                  /
    67.168.96.81     astralreign.com                  /forum/
    67.168.96.81     astralreign.com                  /forum/
    67.168.96.81     astralreign.com                  /forum/
    67.168.96.81     astralreign.com                  /forum/
    69.131.48.17     astralreign.com                  /forum/
    69.131.48.17     astralreign.com                  /forum/
    69.131.48.17     astralreign.com                  /forum/
    69.131.48.17     astralreign.com                  /forum/
    69.131.48.17     astralreign.com                  /threads/man-date-movie-lineup.300/
    69.248.58.195    astralreign.com                  /events/monthly/5.2015/
    72.14.199.2      astralreign.com                  /events/weekly/49.2013/
    76.90.163.13     astralreign.com                  /
    8.29.126.20      astralreign.com                  /members/
    8.29.126.20      astralreign.com                  /members/
    83.23.13.141     astralreign.com                  /
    83.23.13.141     astralreign.com                  /members/
    83.8.156.35      astralreign.com                  /
    83.8.156.35      astralreign.com                  /members/
    89.141.67.247    astralreign.com                  /members/
    89.141.67.247    astralreign.com                  /members//RK=0/RS=KxXhfyDC77vOdiRPVyHGgLCzLAw-
    89.141.67.247    astralreign.com                  /online/
    91.188.117.235   astralreign.com                  /help/cookies
    91.188.117.235   astralreign.com                  /help/cookies
    Google and MSNBot are in there quite a lot
     
  7. Brogan

    Brogan XenForo Moderator Staff Member

    If a host is going to suspend service for that then a new host is in order, IMO.
     
  8. Notturno

    Notturno Member

    Yeah, the weird thing is this hasn't been an issue with my host until the past two weeks or so. I'm kind of at a loss - I'm opening up a ticket to try and get this resolved, but I have no idea what in the world is causing the abuse e-mails to come my way.

    I originally went with them since they boasted some sort of XenForo support, but apparently it's using too many resources on the plan offered. I'm not sure if it's a personal configuration issue, or what. :(
     
  9. MattW

    MattW Well-Known Member

    This part is scary :

    Code:
    05:27:22 up  6:33,  2 users,  load average: 127.97, 184.43, 123.40
     
    euantor likes this.
  10. Notturno

    Notturno Member

    Yeah, and I have no idea what that's all about. I run the site for a very small community (maybe five using the site at once), and the rest are bots. I really don't know what is causing that amount of usage. I'm not the most experienced with a lot of this stuff, so it's pretty baffling to me.
     
  11. MattW

    MattW Well-Known Member

    Their hosting server is probably highly oversold, and because the session table is using MyISAM, it's waiting for the table to unlock before running the next update query, causing a back log of requests.
     
    euantor likes this.
  12. Notturno

    Notturno Member

    So is this considered an unusually high load for XenForo, or is there something I should be investigating into fixing this? :(
     
  13. MattW

    MattW Well-Known Member

    That's an unusually high load for any server, running any kind of application. All they are showing you is what your account was running at the time. Because it's shared hosting, you've no idea what else was happening at the time. I highly doubt that with the output of those incoming connections, you'd be contributing that much to that load. You don't know if they are having disk IO issues for one, so personally.........as @Brogan said, I'd look for a new host.
     
  14. Notturno

    Notturno Member

  15. RobParker

    RobParker Well-Known Member

    What's your xenporta block cache time set to? There are a few REALLY inefficient xenporta blocks that can crash our site when we have heavy traffic.
     
  16. Notturno

    Notturno Member

    Can't check due to my database access still being disabled. I'll look into this though if I get it back - thanks for the suggestion. :)
     
  17. WSWD

    WSWD Well-Known Member

    If that's the load for the server and you are not on a VPS, yes...there is something very, very, wrong with that server. In fact...that's probably about #3 or 4 for the highest load I've ever seen on a hosting server. Ha ha!!

    That said, it does look like your site is getting hit pretty hard with traffic and requests. What are your forum stats, out of curiosity (i.e. how many people normally online at once, etc.)?
     
  18. Notturno

    Notturno Member

    5 users or so average, anywhere from 10-20 guests (bots).

    I'm on a shared package, yeah. I'm just surprised that they think my little site has anything to do with performance issues on their server. :S
     
  19. WSWD

    WSWD Well-Known Member

    Yeah...you shouldn't be causing any sort of issues with that few visitors. Could be an issue with a plug-in, as was mentioned, but it sure sounds like something else.
     
  20. tenants

    tenants Well-Known Member

    1) Those urls with "RK=0/RS" are almost definitely spam bots (with a bad set of urls in their link list, see here)

    2) Your events pages will be getting crawled indefinitely by spiders, since all pages of the events area are indexable, all pages in the events area should not be indexable.
    So this page:
    /events/monthly/1.1970/
    Through to this page
    /events/monthly/12.9999/
    or... what ever the end and start is, will be indexed (that's a lot of duplicate empty pages)
    - This should really be dealt by the plugin, but you can block spiders crawling these via robot.txt,

    Disallow: /events/birthdays/
    Disallow: /events/monthly
    Disallow: /events/weekly
    see here

    3) You will also be getting hit by brute force spam bot attempts (many login attempts, or even hitting certain pages), there are ways to reduce this, but check your logs for most common IPs and google those IP addresses, are they spam bots too?

    Those 3 may contribute to your issues, but by the looks of things... the site has now gone
     
    Last edited: May 10, 2014

Share This Page