[TH] Image Optimizer [Deleted]

[ThemeHouse]

Sorry about that, seems something's got mismatched internally and the build data is different from what's in the file. Should be another build shortly.

A new build is now available

 

[ekool]

I'm on 100,000 of around 500,000 attachments that have been optimized via cmd.php -- The process seems to have slowed down and internal_data/temp has grown quite a bit, about 60G.

Is there a way to stop this process and restart at a certain number? I don't want to stop it now, lest I have to start over from scratch. But if I can tell it to continue from attachment X, then that would be ideal.

This is about 12 hours into the process by the way.

 

[ekool]

Wanted to post an update about this mod for other people interested in how it works on large datasets...

It creates temporary files in the internal_data/temp folder -- and if your attachments directory is say, 37 GB, it will create about 100 GB in the temp folder while it runs. It does not remove the temporary files as it works, instead it only removes them when the entire process is finished.

Make sure you have plenty of extra room when you run this.... if you stop the process it can't restart where you left off and if you stop the process early, I'm not sure if it will even remove the files in the temp dir or you'll have to do it manually.

The size reduction is quite good once the final process is complete. Doing just png and jpeg files my attachment dir went from 37 GB down to 18GB.

 

[rdn]

I got this error on console



Seems I got an older version of gifscile?
Latest version from centos7.

 

[mattrogowski]

What does gifsicle --version output?

 

[rdn]

What does gifsicle --version output?

LCDF Gifsicle 1.91

Copyright (C) 1997-2018 Eddie Kohler
This is free software; see the source for copying conditions.
There is NO warranty, not even for merchantability or fitness for a
particular purpose.

 

[mattrogowski]

LCDF Gifsicle 1.91

Copyright (C) 1997-2018 Eddie Kohler
This is free software; see the source for copying conditions.
There is NO warranty, not even for merchantability or fitness for a
particular purpose.

According to the GitHub history, it was added in 1.92.

 

[rdn]

According to the GitHub history, it was added in 1.92.

Can we have an option on the addon to disable that argument? Please.

 

[mattrogowski]

Can we have an option on the addon to disable that argument? Please.

I guess, but wouldn't it be easier and quicker to update the library? It's likely CentOS just comes with a slightly older version but it can be updated.

 

[rdn]

It's the latest version I can have under centos7 unfortunately.

 

[rdn]

How about these errors?
Generated also via CLI mode.

View attachment Screen Recording 2021-07-04 at 6.13.13 AM.mp4

 

[rdn]

Another error i found also, seems webp isn't excluded?

• ErrorException: Unable to find a suitable image optimizer provider for status ID 5357. Note: This is most likely not a bug and this message is only generated to notify you of the issue. Details: File size: 15742, Mime type: image/webp
• src/XF/Error.php:75

 

[rdn]

According to the GitHub history, it was added in 1.92.

Is this enough to temporarily patch my issue?

#from
$command = $options['binary_path'] . ' --lossy=' . $options['lossy'] . ' --output ' . $newPath . ' --optimize -' . $options['optimize'] . ' -i < ' . $imagePath . ' > ' . $newPath;
#to       
$command = $options['binary_path'] . ' --output ' . $newPath . ' --optimize -' . $options['optimize'] . ' -i < ' . $imagePath . ' > ' . $newPath;

 

[mattrogowski]

Yes, removing the lossy flag from the command will be fine.

If you have a lot of webp images, you may need to use a different optimizer provider.

 

[rdn]

If you have a lot of webp images, you may need to use a different optimizer provider.

My only inactive provider is kraken and guetzli.

 

[rdn]

Yes, removing the lossy flag from the command will be fine.

After doing it, I have 0% savings now.
Not sure what's the problem.

 

[rdn]

What is the correct argument to declare on CLI to use a custom value for "Items to process per page"?

In addition to:

php cmd.php xf-rebuild:thimageopt-optimize-existing-image
php cmd.php xf-rebuild:thimageopt-optimize-existing-image --type=attachment

 

[Lukas W.]

The argument is --batch=X or -b X. You can always get a list of available arguments and parameters by typing --help behind a given command.

 

[rdn]

I've run the CLI command 2 days ago... after running it for 39 hours and done 42% only of the total attachment I cancel it to change the batch count.

Now running again for 11 hours, seems to skip old attachments that are already optimize.

Problem is /internal_data/temp/ has 285 GB already.

Can I clear this folder now?
Or i should wait for it to finish?
Estimate 2-3 days more to go.

And I have 261 GB free disk only now.
My total forum size before running the command is only 313 GB (2 days ago).

 

[rdn]

A must have addon for big boards.
60-85% saving for storage and bandwidth.

View attachment Screen Recording 2021-07-07 at 2.55.00 PM.mp4