UK Online Safety Regulations and impact on Forums

Just doing some reading etc about how to use exiftool :-) Most of it seems to be about how to use it with photos actually on your computer, not within a website like Xenforo.

But I've "saved image" from a selection of images in content-attachments, onto my computer, opened with photos app, checked information, and they appear to have had exif data removed. Unless it's different because it's been saved elsewhere?

So assuming that's the case, and resizing has removed it for larger files, I guess what I need to do somehow is scan all attached images to see which ones (if any) still have exif data (ie smaller files).
 
I'm guessing my attachments/images don't actually have any exif data saved after the resizing. I've found one or two of the smallest images (ie very small when uploaded and only 213kb in size) and those still have some exif data but only the name and model of the phone used, and the photo settings ie iso, aperture etc. No specific phone identification number or anything personally identifiable.

Assume small file size means kb or mb rather than size of the picture itself.
 
Those were early ones from before I had auto re-sizing. Later ones seem to range between 69k and 146kb. No exif data on either. But I'm not sure if I'm checking it right. Just saving the photo on computer, opening it with the photos app and checking information/properties.
 
So the smallest, earliest photo I've found, before I implemented image resizing, was 19kb. No exif data. So maybe I'm safe to assume none of the photos on the site have any identifying exif data? This is by finding a photo in a thread, saving it to computer, checking properties of the saved photo.
 
Thank you for your help :-) I didn't quite understand all that :-) Are these directories in the server or part of XF? And presumably that would tell me how many directories there were to know which number of directory to check? Also where do you run that code? Sorry for asking so many questions. And yes it is just the location I want to remove.
Sorry, there is always a degree of diving in headfirst once you start poking under the hood of software! Whilst I don't generally suggest you go poking around your install unless you feel comfortable (and well worth learning enough to be moderately comfortable). With modern control panels and so forth I forget how likely it is that some people may never have used a shell to access their server and deal with it directly.

The directories are generally within your Xenforo installation. So you normally have data and internal_data directories within each install, typically at the root of your xenforo installation. Where that installation is will depend very much on your server setup and if you've not done that yourself you could try asking your provider although it's unlikely you're not using the standard layout.

Those two folders contain all your generated data, things like caches, attachments, etc. Attachments span over both directories. The thumbnails being in data/attachments and are publicly accessible (even those embedded in private messages), the actual attachments themselves are in internal_data/attachments.

To avoid there being too many files in those directories (imagine if you had thousands of attachments) the actual files are placed within numbered subdirectories. So if you wanted a copy of all your attachments to check locally you'd want to copy down the entire contents to the internal_data/attachments directory.

Both the attachments and their thumbnails are renamed from the file the user actually uploads. They are given an ID when added to the database (data_id) and this combined with an MD5 checksum of the file, so each file looks something like: 6269-4c3e3cc924b72acc7bf11357fb1546a4, in that example the data_id is 6269, the rest is the MD5 hash of the file contents. Thumbnails have the file extension .jpg (although I guess on newer XF it may well be .webp), the actual attachment data has a .data extension (it's still an image file, but has been given a different file extension). The subdirectories are calculated from the data_id by taking the thousands element of the id, so the above example would be located in a directory named: 6 (ie [6269/1000] = 6), an ID of 100 would end up in a directory named 0, etc. Directories are created by XF as needed as the number of attachments you have grows.

If you do download the actual attachment files (those with the .data extension) you will probably find you'll need to rename them so your operating system recognises them as images and lets you easily open them to check the metadata. I would suggest that's quite possibly the easiest way for you to check existing assets.
 
Thank you very much :-) I really appreciate that. I do use the command line a little bit on occasion (if I know what to put in it after looking something up!).

So my "saving" some individual photos from forum threads onto computer and checking them isn't accurate then? It needs to be the actual files in the server that are checked?
 
Also,, how long has that tick box about terms and privacy been there at registration? I'm certain it wasn't there when I set the forum up in late 2022 and set up a couple of spare accounts over the next few months. It means the registration page doesn't quite fit on a 13" laptop screen and its another small step. Now I know people can change the size of things on screen with control plus/minus but ............... it fits fine without the additional tickbox.

I am sure it has only appeared since I updated the terms of service (ie made them longer). Unless it is just that I haven't registered an account for a couple of years.
 
If you do download the actual attachment files (those with the .data extension) you will probably find you'll need to rename them so your operating system recognises them as images and lets you easily open them to check the metadata.
Yes found all those in server, thank you.

What would I rename them to, to view? Change .data to .jpeg?
 
They open in photoshop without changing the file name. It would take a very long time to check each file individually! I assume I'd need some sort of script or something to run to scan them all. Anyway I have randomly checked a few from each file and no data - the occasional one has camera data only - none have any GPS data. So I suspect the resizing set up in the early days of the forum, has removed exif data.

Even photos from the first couple of months only have camera data showing but I'll go through that first two months worth (from before the resizing was implemented).

Edit - I assume the exiftool script you mentioned earlier is to scan them all :-) I'll go back and look at that ..........

I did see a video where someone set up an exiftool "tool" to drop photos into and remove exif data. But I'm not wanting to remove it - just see if it's there.

Although from the random checking I've done I'm guessing there isn't any there. But I guess that isn't a definitive "there is no exif or GPS data stored".
 
Last edited:
Is it ok to just download the jpeg thumbnails? Assume they would also contain the same metadata?

Edit - no - thumbnails show less info than the full file (either that or "Photos" in Windows shows less info than photoshop.
 
Last edited:
Is it ok to just download the jpeg thumbnails? Assume they would also contain the same metadata?

Edit - no - thumbnails show less info than the full file (either that or "Photos" in Windows shows less info than photoshop.
Either way, I've manually checked about 200 files and they all have either no metadata, or minimal metadata and no GPS. The odd one taken with a "proper" camera has camera type and iso/aperture settings etc.

So I think I can safely assuming that automatic resizing has removed metadata (most of it). Although it would be nice to be certain and scan everything.

I did download exiftool to see if I could check a whole folder of files, but couldn't get it to work :rolleyes: After trying various ways. Might be a Windows 11 thing.
 
Last edited:
So I found this - which checks the files in browser. Uploaded a whole directory of jpeg thumbnails and they all said "no metadata found".

 
It needs to be the actual files in the server that are checked?
As long as you are looking at the fullsize images (not the thumbs) then that's fine - that is the data coming from the server!
They open in photoshop without changing the file name. It would take a very long time to check each file individually! I assume I'd need some sort of script or something to run to scan them all.
I expect there are tools around to do such things. Depends what operating system you are on. You might even be able to use exiftool on your platform.
Is it ok to just download the jpeg thumbnails? Assume they would also contain the same metadata?
They wont have any data, much like if you have had XF resize the "main" files the thumbnails don't have the metadata copied over when they are created. Resized images loose it because in essence they are new files created by XF from the originals and XF only copies the picture data into the new (smaller) file, not all the embedded metadata. That might of course change in the future!

Sounds like you've pretty much confirmed you're good as far as sneaky old EXIF data goes!
 
As long as you are looking at the fullsize images (not the thumbs) then that's fine - that is the data coming from the server!

I expect there are tools around to do such things. Depends what operating system you are on. You might even be able to use exiftool on your platform.

They wont have any data, much like if you have had XF resize the "main" files the thumbnails don't have the metadata copied over when they are created. Resized images loose it because in essence they are new files created by XF from the originals and XF only copies the picture data into the new (smaller) file, not all the embedded metadata. That might of course change in the future!

Sounds like you've pretty much confirmed you're good as far as sneaky old EXIF data goes!
Thank you. Although I have only scanned thumbnails unfortunately. I've checked about 50 or so .data files manually in photoshop.

Any idea how I can convert the .data files to jpegs in Windows?
 
Couldn't get exiftool to work, even with the commandline. I watched a video that showed dragging and dropping the .exe. file into windows c root. Might try that on a different computer but I don't want to mess up my main one!
 
Any idea how I can convert the .data files to jpegs in Windows?
They will already be JPEGs, just without the "right" extension - there are probably batch renaming tools around for Windows that will allow you to change the file extension of a load of files at once - https://www.bulkrenameutility.co.uk/ is what came up when I just did a search - no idea how good/bad it is. Or as you found with photoshop some tools will happily open them as they are.

In searching https://geosetter.de/en/main-en/ came up a few times, seems like it's using exiftool under the hood, but being a GUI it might lend itself to being easier. Not quite sure if you can see metadata for multiple files at once, but may be worth investigating a little... Again not something I've ever used so your milage may vary!
 
Thanks you for those suggestions. I can batch rename the files easily enough in Windows, but that doesn't seem to extend to the file extension. I'm not even sure if exiftool reads .data files.
 
Back
Top Bottom