Implemented Remote Attachments storage

[Max]

Storing large amounts of attachments on the same server as the forum giving space and server load problems.

So it will be really nice if we can store attachments on Amazon S3 or separate server.

This will be really helpful for addons like Galleries, Resource manager etc.. too.

 

[inkognito23]

i am going to switch my board (800k registred users, 4mio. posts) from vb3.8.x to another forum software (XF or IPB).

we have a huge amount of files, attachements on our server. the best way for speed improvements is to store attachements on other servers than the same server where the core forum software is running on.

i very liked to see the option.

IPB will come out with this feature with the 4.0 version.
http://community.invisionpower.com/topic/394248-40-file-storage/

please mike & kier, take a look at IPBs external storage feature and develop a better one, so the xenforo community will love XF more and more...

best

 

[0ptima]

There is an addon for that
http://xenforo.com/community/resources/bd-attachment-store.1779/

 

[inkognito23]

yeah, but i liked to see that in the core. i dont like 3rd party coded stuff, because i dont know if its well coded...

also, the IPB core feature allows you to set individual preferrences for attachement types, e.g. avatars should stored in database, but jpg in external storage...

i also would love to see, if we can add cluster of external storage servers...

 

[0ptima]

How many files do you have?

 

[inkognito23]

too many, i guess 200k ... we have roughly 20-30TB traffic through files per month...

 

[0ptima]

Sorry, I should have been more clear. How much space do they take?

 

[inkognito23]

close to 1TB disk space

 

[0ptima]

Maybe such a feature will be released in XF 1.3
Stay tuned to here....

 

[inkognito23]

i would love to see this feature in XF1.3 core...

 

[MattW]

yeah, but i liked to see that in the core. i dont like 3rd party coded stuff, because i dont know if its well coded...

@xfrocks is one of the best 3rd party coders for XenForo around, and all his add-ons are very well coded.

I've only got a small site with 42,000 attachments, but using his add-on to serve them all via the CDN.

 

[inkognito23]

Hi MattW,

thanks for feedback. But like i said before, IPB going to implement this feature into the core system. And i would like to see this also in the XF core.

Also, options for CDN preferences in the core is a Must-Have, imo.

At the moment, on my vB3.8.x i host eg. static files like .js/.css/.jpg/.gifs etc. on my own CDN server (via varnish) without any need of 3rd party addons.

 

[Mouth]

At the moment, on my vB3.8.x i host eg. static files like .js/.css/.jpg/.gifs etc. on my own CDN server (via varnish) without any need of 3rd party addons.

You can achieve that now without add-ons. XF has CDN support in core.

 

[inkognito23]

that should be somewhere in the config.file? i just have login for the demo.xenforo.com site atm. And in the admin-panel, i cant see any options to do that...

so i can give for .js and .css files like static1.domain.com, and for image files like img.domain.com ? Can i use different CDN domain for different file types?

 

[Mouth]

that should be somewhere in the config.file? i just have login for the demo.xenforo.com site atm. And in the admin-panel, i cant see any options to do that...
so i can give for .js and .css files like static1.domain.com, and for image files like img.domain.com ? Can i use different CDN domain for different file types?

Yes, and yes.
http://xenforo.com/help/config-php-options/

 

[inkognito23]

in this document i can just see, that for .js and data you can apply CDN, but where i can apply CDN URL for just style grafics?

 

[MattW]

in this document i can just see, that for .js and data you can apply CDN, but where i can apply CDN URL for just style grafics?

You need to go into the ACP --> Appearance --> Style Properties --> General and set Path To Images

EG, I had them on images.z22se.org.uk as the CDN, so set the style property to be http://images.z22se.org.uk/styles/uix (for that particular theme)

 

[Main Company]

Can anyone suggest other external storage options besides Amazon's S3.

 

[md_5]

Gonna give this another bump.

Lemme know if you'd like a thread with more info.

 

[lantek]

Would love to see this in XF2, ideally native.