Redis backed view counters 2.5.0

[developr]

What will happen if we have more then 100k threads?

 

[Xon]

What will happen if we have more then 100k threads?

This add-on only updates actively viewed threads, not total number of threads. I'm fairly sure most XF forums don't have nearly that many active threads at any given time.

The code actually works based on total number of keys, so it just takes longer to visit all of them;

XenForo2-RedisViewCounter/upload/src/addons/SV/RedisViewCounter/Repository/ContentView.php at 1dffbf1abd3586f49f51cc1fd2f8e910855b4088 · Xon/XenForo2-RedisViewCounter

Move some view counter to Redis-based increment counters rather than MySQL - Xon/XenForo2-RedisViewCounter

github.com

 

[Xon]

Xon updated Redis View Counters with a new update entry:

2.3.0 - Feature & bugfix update

This add-on is now available on atelieraphelion.com

• Require php 7.2+
• Require XenForo 2.2+
• Require Redis v3.0.0+
• Remove deprecated code, hard requiring Redis v2.6+
• Fix page views where not being updated as expected
• Add support for @Bob's Article Management System
• Add support for XenForo Resource Manager

Read the rest of this update entry...

 

[Xon]

Xon updated Redis View Counters with a new update entry:

2.4.0 - XF2.3 Compatibility update

• Requires StandardLib v1.19.0+
• Requires Redis Cache v2.17.0+
• XF2.3 compatibility update

Read the rest of this update entry...

 

[Xon]

Xon updated Redis View Counters with a new update entry:

2.4.1 - Maintenance update

• Restore XF2.1 support
• XF2.3 support requires Redis Cache v2.17.0+

Read the rest of this update entry...

 

[Xon]

Xon updated Redis backed view counters with a new update entry:

2.5.0 - Maintenance update

• Adjust add-on title to be "Redis backed view counters"
• Require StandardLib v1.22.0+
• Fix Redis Cache dependency did not report the required version correctly
• Implement content view updates in a background job instead of a blocking process during the cron-tasks

Read the rest of this update entry...

 

[ekool]

I noticed that I tried to install this on a site and it wants an older version than is available to install. Same for redis flood checker.

Could not process SV-RedisViewCounter-2.5.0 (1).zip: The following requirements for Redis backed Views Counters were not met: Redis backed Views Counters requires Redis Cache v2.17.0.

I have newer than that version....

 

[Xon]

Make sure the Redis Cache add-on is installed and active, it looks like it is missing the + sign to indicate newer versions

 

[ekool]

Make sure the Redis Cache add-on is installed and active, it looks like it is missing the + sign to indicate newer versions

It is installed and active and I'm using it.

[HEADING=2]Oops! We ran into some problems.[/HEADING]
Could not process SV-RedisViewCounter-2.5.0.zip: The following requirements for Redis backed Views Counters were not met: Redis backed Views Counters requires Redis Cache v2.17.0.

Redis Information
Version    7.2.14
phpredis version    6.1.0
Serializer    igbinary
Free memory    Unlimited
Used memory    2.8 MB
Peak memory    4.1 MB
Maximum memory    0 bytes
Maximum memory policy    noeviction
To Redis (kbps)    28
From Redis (kbps)    1,946
Operations per second    31
DB 0 Keys    898
DB 0 Average TTL    4,526,676
Connected clients    2

I have different namespaces in the config.php -- since I have more than one site sharing the redis server, could it be related to that?

 

[Xon]

Make sure you've updated src/config.php to set the Cache provider;

$config['cache']['provider'] = 'SV\RedisCache\Redis';

Also try rebuilding SV/StandardLib add-on.

 

[benFF]

Am I right in thinking this should update the database (thread table) every 15 minutes when the cron runs?

I'm using Garnet (the Windows Redis compatible server) - which does support LUA, but nothing seems to happen and the cache just fills up with loads of thread counter keys, never being removed nor updating the database table.

Is there something else I need to change, or just not compatible?

 

[Xon]

Yes, it should push thread view changes every 15 minutes or so.

Try running the update view count crons repeatedly and see if the view counts go down. It is possible there are bots hammering away so it is continuously seeing lots of small number of views in e every thread

 

[benFF]

I was focused on one entry to see if it ever disappeared, but perhaps that was lower down in the queue...


Ok I'll try again later and keep hammering the cron.

But if it is due to a bot hammering, there's no solution (as in it will never catch up?)

How many records at a time does it process?

 

[Xon]

How many records at a time does it process?

It triggers a background job which processes upto 4000 threads at a time. It uses the redis scan command so it will visit every key without missing.

I guess it needs to be more aggressive, but provided the job.php is called frequently enough it'll catch up fairly quickly.

 

[benFF]

It triggers a background job which processes upto 4000 threads at a time. It uses the redis scan command so it will visit every key without missing.

I guess it needs to be more aggressive, but provided the job.php is called frequently enough it'll catch up fairly quickly.

It might just be a garnet thing, I'll try again and report back

Thanks.