What to do with very large images? AstroBin Platform open discussions community forum · Regulus Remains · ... · 11 · 191 · 1

rrapier 1.51
...
· 
·  Share link
All of my images these days are 10GB xsif files, and dropping them down to 24k by 16k PNGs results in an image that is still too large for astrobin.
I can't be the only one, as I'm using a run-of-the-mill Zwo 2600 and still hitting the limitation. I can't imagine what the 60MP and 100MP guys are doing. Do I have to self-host these images?
Do you think Astrobin has plans to expand its image capabilities?
Like
siovene
...
· 
·  Share link
Hi Regulus, how large are these files in MB? Astrobin should let you upload up to gigabytes, tho depending on the image, over a few hundred megabytes might struggle to generate thumbnails.
Like
rrapier 1.51
Topic starter
...
· 
·  Share link
my PNG files are usually 300-500MB. Astrobin warns that files over 8000x8000 pixels may not function correctly. Followed by, " Sorry, but this image is too large. The maximum allowed total number of pixels is 273439296." I'm a very generous man and want to give more pixels.
Edited ...
Like
siovene
...
· 
·  Share link
Hmm, you mention that you have a ZWO 2600. Isn't that 6248x4176 pixels? How do you end up with 4 times that resolution? Is it mosaics or supersampling?

In any case, 8000x8000 is too conservative an estimate, they will very likely work!

The issue is some very large images might run a server out of memory, but I haven't really seen it happen to be honest. For instance I see that your latest M42 worked fine, and that's 18499×12805 and 250 MB.

Regarding the 273439296 pixel count, which is 16536x16536, for instance, is a security feature in place to prevent something called a "decompression bomb", when a malicious party could upload an image that decompresses to a ridiculous size and kill a server.

However, these measures were put in place on AstroBin a long time ago, and they can be both raised safely! Especially the total pixel count because only paying users would be able to upload such large files anyway, and the worst that can happen is that a worker crashes while generating the email.

Let me double both limitation and it would be great if you could try them with some of your large images to see if AstroBin copes well!
Like
siovene
...
· 
·  Share link
Salvatore Iovene:
Let me double both limitation and it would be great if you could try them with some of your large images to see if AstroBin copes well!

The code has been updated, and it takes about an hour to deploy!
Like
rrapier 1.51
Topic starter
...
· 
·  Share link
You did a lot more work than I deserve. I mostly play around with the best ways to make my processing servers cry. In doing so, I've found an odd amount of detail in the widefield shots.  Again, I really appreciate this! (oh, and dithering every frame + 4 X drizzle) 
PM1-333.png
Edited ...
Like
DalePenkala 19.38
...
· 
·  Share link
Just an FYI,

I always upload JPEG files and I do use the 2600mc pro cameras now on both of my rigs. The OP must be doing some drizzle and maybe other stuff it bring files up that large. I always work with the XFIS files in PI but when I’m done with my image to upload to AB I always use 100% quality and save to the jpeg format.
Like
TareqPhoto 2.94
...
· 
·  1 like
·  Share link
Dale Penkala:
Just an FYI,

I always upload JPEG files and I do use the 2600mc pro cameras now on both of my rigs. The OP must be doing some drizzle and maybe other stuff it bring files up that large. I always work with the XFIS files in PI but when I’m done with my image to upload to AB I always use 100% quality and save to the jpeg format.

I agree with you, i always share my images in JPEG format, i sometimes save files as TIFF or PNG depends on images i want to keep a non-compressed files for later, but once i am done then the final step is convert it to JPEG then upload, i have like two separated drives, one is only for RAW and out of camera formats, and the other drive is only for processed and compressed files, in future i even can add third one so i can have even more space for each format just in case, i can buy more hard drives nowadays as they are more affordable.
Like
rrapier 1.51
Topic starter
...
· 
·  Share link
Salvatore Iovene:
Salvatore Iovene:
Let me double both limitation and it would be great if you could try them with some of your large images to see if AstroBin copes well!

The code has been updated, and it takes about an hour to deploy!

250mb jpeg and 600MB PNG (24k by 16k) are giving a 404 error after the upload finishes, with a small popup displaying a 504 error.
Like
DalePenkala 19.38
...
· 
·  Share link
I don’t know how you can endup with a jpeg file that is 250mb with that camera even with drizzled data.
Like
rrapier 1.51
Topic starter
...
· 
·  Share link
Dale Penkala:
I don’t know how you can endup with a jpeg file that is 250mb with that camera even with drizzled data.

I do drag the slider to 100% =D
Like
TareqPhoto 2.94
...
· 
·  Share link
Regulus Remains:
Dale Penkala:
I don’t know how you can endup with a jpeg file that is 250mb with that camera even with drizzled data.

I do drag the slider to 100% =D

Drag it to 10% please 
Like
 
Register or login to create to post a reply.