Unusually high resource usage?

[Notturno]

So, I just recently had my database access with Arvixe disabled - apparently XenForo is using up too many resources? I have barely anyone using my site, and I have absolutely no idea what's causing the load issues.

I was given this text file as evidence, but I'm not entirely sure what to conclude from it. I really have no idea where to begin looking at what's causing the resource abuse.

I'm running XenForo 1.5, XenPorta, XenMedio, XenAtendo, and Simple Forms, if that helps.

Any ideas or information would be a huge help.

 

[Paul B]

The first step is to disable add-ons and test again.
Are your tables correct, as far as InnoDB, MyISAM and Memory are concerned?

The next thing to look at is server tuning/configuration.

If none of that helps, consider moving hosts.

 

[Digital Doctor]

Maybe this is a clue ?
Waiting for table level lock| INSERT INTO `xf_session` (`session_id`, `session_data`, `expiry_date`) VALUES (?, ?, ?)|

Any ideas in this search ? or this thread ?

 

[Notturno]

Well at this point, they disabled access to my database, I wouldn't even be able to try disabling my add-ons to fix it. I guess I'm going to have to try getting my access back to see what's going on.

As for the databases, the weird thing is I haven't changed anything - I've been with them for nine months and this has just recently became an issue.

 

[Paul B]

If they have disabled access then there's nothing you can do to investigate and attempt to solve the issue.

Therefore my final point would appear to be the best course of action.

 

[MattW]

Looks like you are getting hit quite hard by bots:

Incoming Connections:
107.158.229.204  astralreign.com                  /members/
107.181.70.166   astralreign.com                  /members//RK=0/RS=TiY593xCYqHp_8un06DGij0Z2g8-
107.181.70.167   astralreign.com                  /members//RK=0/RS=TiY593xCYqHp_8un06DGij0Z2g8-
108.53.148.252   astralreign.com                  /cron.php?1397640324
108.53.148.252   astralreign.com                  /pages/about/
108.61.136.34    astralreign.com                  /help/
108.61.136.34    astralreign.com                  /help/
108.61.136.34    astralreign.com                  /help/bb-codes
108.61.136.34    astralreign.com                  /help/bb-codes
113.57.252.104   astralreign.com                  /members/
116.112.66.102   astralreign.com                  /search/
117.74.121.218   astralreign.com                  /members/
119.252.160.34   astralreign.com                  /search/
138.91.92.148    astralreign.com                  /members/annmarieh.188/
157.55.33.79     astralreign.com                  /forms/
157.55.33.79     astralreign.com                  /forms/
157.55.33.79     astralreign.com                  /forms/
157.55.33.79     astralreign.com                  /link-forums/about.40/
157.55.33.79     astralreign.com                  /link-forums/about.40/
157.55.33.79     astralreign.com                  /link-forums/about.40/
157.55.35.40     astralreign.com                  /events/weekly/44.2012/members/shyguyspirit.11/
157.55.35.40     astralreign.com                  /index/index.rss
157.55.35.40     astralreign.com                  /index/index.rss
157.55.35.40     astralreign.com                  /index/index.rss
157.55.35.40     astralreign.com                  /members/artie.281/
157.55.35.40     astralreign.com                  /members/artie.281/
157.55.35.40     astralreign.com                  /members/artie.281/
157.55.35.40     astralreign.com                  /pages/faq/
157.55.35.40     astralreign.com                  /pages/faq/
157.55.35.40     astralreign.com                  /pages/faq/
162.244.11.7     astralreign.com                  /help/bb-codes
162.244.11.7     astralreign.com                  /help/bb-codes
173.0.57.29      astralreign.com                  /help/bb-codes
173.232.105.113  astralreign.com                  /members//RK=0/RS=7M1d2M4ZvFeMY6fqo1xVz2OMocY-
180.180.118.253  astralreign.com                  /
183.207.228.14   astralreign.com                  /members/
183.60.213.38    astralreign.com                  /pages/teamspeak/help/smilies
183.60.214.126   astralreign.com                  /pages/teamspeak/help/
184.105.235.40   astralreign.com                  /members//RS=^ADACVQ7VPprjmlNJpCRhGI7QcEW3jY-
184.154.7.28     astralreign.com                  /help/bb-codes
188.240.129.76   astralreign.com                  /help/bb-codes
188.240.129.76   astralreign.com                  /help/bb-codes
198.175.124.97   astralreign.com                  /members/
198.20.81.37     astralreign.com                  /members//RK=0/RS=Mfsf_4HLoPZTZuqDIv4mlHSetx0-
198.23.248.15    astralreign.com                  /members/
198.50.235.17    astralreign.com                  /members/vyxxi.2/
198.50.240.80    astralreign.com                  /members/
198.50.253.80    astralreign.com                  /members/
198.50.253.80    astralreign.com                  /members/
198.50.253.80    astralreign.com                  /online/
198.50.253.80    astralreign.com                  /online/
202.43.115.50    astralreign.com                  /members/meracle-starr.284//RK=0/RS=fQAWkuFsdwpI1upqH6uRKuK
211.139.149.71   astralreign.com                  /
212.13.102.42    astralreign.com                  /members/meracle-starr.284//RK=0/RS=fQAWkuFsdwpI1upqH6uRKuK
213.192.26.6     astralreign.com                  /
23.105.54.16     astralreign.com                  /recent-activity/
23.231.7.47      astralreign.com                  /members/anitalack.124/
23.252.107.117   astralreign.com                  /forms/?page=0
23.254.134.187   astralreign.com                  /help/bb-codes
23.254.134.187   astralreign.com                  /help/bb-codes
23.81.206.182    astralreign.com                  /
23.81.206.182    astralreign.com                  /members/
31.7.56.170      astralreign.com                  /
31.7.56.170      astralreign.com                  /members/
37.187.79.141    astralreign.com                  /members/
46.4.24.148      astralreign.com                  /members/
46.4.24.148      astralreign.com                  /members//RK=0/RS=2rz9RdWmlfhEGDpXBBwTiDg1Wxk-
46.4.24.148      astralreign.com                  /online/
5.153.237.229    astralreign.com                  /
59.58.189.146    astralreign.com                  /threads/astral-reign-starbound-server.293
62.210.113.18    astralreign.com                  /help/bb-codes
62.210.113.18    astralreign.com                  /members/annmarieh.188/
64.14.41.15      astralreign.com                  /members/
66.249.70.225    astralreign.com                  /members/bob-saget.270/recent-activity
66.249.73.235    astralreign.com                  /events/monthly/10.1994/
66.249.73.235    astralreign.com                  /events/monthly/10.1994/
66.249.73.235    astralreign.com                  /events/monthly/10.1994/
66.249.73.235    astralreign.com                  /events/monthly/2.1995/
66.249.73.235    astralreign.com                  /events/monthly/2.1995/
66.249.73.235    astralreign.com                  /events/monthly/3.2038/
66.249.73.235    astralreign.com                  /events/monthly/3.2038/
66.249.73.235    astralreign.com                  /events/monthly/7.1994/
66.249.73.235    astralreign.com                  /events/monthly/7.1994/
66.249.73.235    astralreign.com                  /events/monthly/7.1994/
66.249.73.235    astralreign.com                  /events/monthly/8.1994/
66.249.73.235    astralreign.com                  /events/monthly/8.1994/
66.249.73.235    astralreign.com                  /events/monthly/8.1994/
66.249.73.235    astralreign.com                  /events/monthly/9.1994/
66.249.73.235    astralreign.com                  /events/monthly/9.1994/
66.249.73.235    astralreign.com                  /events/monthly/9.1994/
66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
66.249.73.235    astralreign.com                  /media/defiance-shadow-war-34-1-6.5/
66.249.73.235    astralreign.com                  /members/
66.249.73.235    astralreign.com                  /members/
66.249.73.235    astralreign.com                  /members/
66.249.73.235    astralreign.com                  /members/jcvd.228/
66.249.73.235    astralreign.com                  /members/jcvd.228/
66.249.73.235    astralreign.com                  /members/jcvd.228/
66.249.73.235    astralreign.com                  /members/notturno.1/
66.249.73.235    astralreign.com                  /members/notturno.1/
66.249.73.235    astralreign.com                  /members/notturno.1/
66.249.73.235    astralreign.com                  /posts/1109/
66.249.73.235    astralreign.com                  /posts/1109/
66.249.73.235    astralreign.com                  /posts/1109/
66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
66.249.73.235    astralreign.com                  /threads/man-date-5-kung-fu-hustle.306/
66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
66.249.73.235    astralreign.com                  /threads/quick-addon-guide.339/
66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
66.249.73.235    astralreign.com                  /threads/second-astral-reign-man-date.285/
66.249.76.170    astralreign.com                  /events/weekly/11.2014/
66.249.76.181    astralreign.com                  /members/bob-saget.270/recent-content
66.249.76.181    astralreign.com                  /members/kaburma.259/recent-activity
66.69.218.38     astralreign.com                  /
67.168.96.81     astralreign.com                  /forum/
67.168.96.81     astralreign.com                  /forum/
67.168.96.81     astralreign.com                  /forum/
67.168.96.81     astralreign.com                  /forum/
69.131.48.17     astralreign.com                  /forum/
69.131.48.17     astralreign.com                  /forum/
69.131.48.17     astralreign.com                  /forum/
69.131.48.17     astralreign.com                  /forum/
69.131.48.17     astralreign.com                  /threads/man-date-movie-lineup.300/
69.248.58.195    astralreign.com                  /events/monthly/5.2015/
72.14.199.2      astralreign.com                  /events/weekly/49.2013/
76.90.163.13     astralreign.com                  /
8.29.126.20      astralreign.com                  /members/
8.29.126.20      astralreign.com                  /members/
83.23.13.141     astralreign.com                  /
83.23.13.141     astralreign.com                  /members/
83.8.156.35      astralreign.com                  /
83.8.156.35      astralreign.com                  /members/
89.141.67.247    astralreign.com                  /members/
89.141.67.247    astralreign.com                  /members//RK=0/RS=KxXhfyDC77vOdiRPVyHGgLCzLAw-
89.141.67.247    astralreign.com                  /online/
91.188.117.235   astralreign.com                  /help/cookies
91.188.117.235   astralreign.com                  /help/cookies

Google and MSNBot are in there quite a lot

 

[Paul B]

If a host is going to suspend service for that then a new host is in order, IMO.

 

[Notturno]

Yeah, the weird thing is this hasn't been an issue with my host until the past two weeks or so. I'm kind of at a loss - I'm opening up a ticket to try and get this resolved, but I have no idea what in the world is causing the abuse e-mails to come my way.

I originally went with them since they boasted some sort of XenForo support, but apparently it's using too many resources on the plan offered. I'm not sure if it's a personal configuration issue, or what.

 

[MattW]

This part is scary :

05:27:22 up  6:33,  2 users,  load average: 127.97, 184.43, 123.40

 

[Notturno]

This part is scary :

05:27:22 up  6:33,  2 users,  load average: 127.97, 184.43, 123.40

Yeah, and I have no idea what that's all about. I run the site for a very small community (maybe five using the site at once), and the rest are bots. I really don't know what is causing that amount of usage. I'm not the most experienced with a lot of this stuff, so it's pretty baffling to me.

 

[MattW]

Their hosting server is probably highly oversold, and because the session table is using MyISAM, it's waiting for the table to unlock before running the next update query, causing a back log of requests.

 

[Notturno]

So is this considered an unusually high load for XenForo, or is there something I should be investigating into fixing this?

 

[MattW]

So is this considered an unusually high load for XenForo, or is there something I should be investigating into fixing this?

That's an unusually high load for any server, running any kind of application. All they are showing you is what your account was running at the time. Because it's shared hosting, you've no idea what else was happening at the time. I highly doubt that with the output of those incoming connections, you'd be contributing that much to that load. You don't know if they are having disk IO issues for one, so personally.........as @Brogan said, I'd look for a new host.

 

[Notturno]

Well that's disappointing, guess I'll be looking for a new host then.

Thanks for the help @MattW, @Digital Doctor and @Brogan

 

[RobParker]

What's your xenporta block cache time set to? There are a few REALLY inefficient xenporta blocks that can crash our site when we have heavy traffic.

 

[Notturno]

What's your xenporta block cache time set to? There are a few REALLY inefficient xenporta blocks that can crash our site when we have heavy traffic.

Can't check due to my database access still being disabled. I'll look into this though if I get it back - thanks for the suggestion.

 

[WSWD]

If that's the load for the server and you are not on a VPS, yes...there is something very, very, wrong with that server. In fact...that's probably about #3 or 4 for the highest load I've ever seen on a hosting server. Ha ha!!

That said, it does look like your site is getting hit pretty hard with traffic and requests. What are your forum stats, out of curiosity (i.e. how many people normally online at once, etc.)?

 

[Notturno]

If that's the load for the server and you are not on a VPS, yes...there is something very, very, wrong with that server. In fact...that's probably about #3 or 4 for the highest load I've ever seen on a hosting server. Ha ha!!

That said, it does look like your site is getting hit pretty hard with traffic and requests. What are your forum stats, out of curiosity (i.e. how many people normally online at once, etc.)?

5 users or so average, anywhere from 10-20 guests (bots).

I'm on a shared package, yeah. I'm just surprised that they think my little site has anything to do with performance issues on their server. :S

 

[WSWD]

5 users or so average, anywhere from 10-20 guests (bots).

I'm on a shared package, yeah. I'm just surprised that they think my little site has anything to do with performance issues on their server. :S

Yeah...you shouldn't be causing any sort of issues with that few visitors. Could be an issue with a plug-in, as was mentioned, but it sure sounds like something else.

 

[tenants]

1) Those urls with "RK=0/RS" are almost definitely spam bots (with a bad set of urls in their link list, see here)

2) Your events pages will be getting crawled indefinitely by spiders, since all pages of the events area are indexable, all pages in the events area should not be indexable.
So this page:
/events/monthly/1.1970/
Through to this page
/events/monthly/12.9999/
or... what ever the end and start is, will be indexed (that's a lot of duplicate empty pages)
- This should really be dealt by the plugin, but you can block spiders crawling these via robot.txt,

Disallow: /events/birthdays/
Disallow: /events/monthly
Disallow: /events/weekly
see here

3) You will also be getting hit by brute force spam bot attempts (many login attempts, or even hitting certain pages), there are ways to reduce this, but check your logs for most common IPs and google those IP addresses, are they spam bots too?

Those 3 may contribute to your issues, but by the looks of things... the site has now gone