CCP Data Sets

This is a community page for links to tomographic data sets for test and outreach purposes.

Zenodo CCPi community page:

See below (bottom of page) for some instructions for uplading your datasets.

Tomographic Data for Touch Tables

Data sets for Drishti Prayog enabled touch-tables.

  1. Installation page has test data sets there for Drishti-Prayog users (Drishti is developed by the NCI VizLab: nci.org.au/drishti).

Tomographic Data for Testing Purposes

SophiaBeads Datasets (Copyright (c) 2015 Sophia Bethany Coban) "are acquired specifically for testing and comparing reconstruction methods used for computed tomography problems. Our main objective is to provide a framework where reconstruction methods can be implemented and tested with the use of these datasets, where we know what the reconstructed image is."

Upload Instructions

Thanks to Sophia for the first version of instructions to the community:

Store your data in the clouds:

First things first: Create free cloud storage accounts (or empty your current ones). These could be OneDrive , GoogleDrive, etc. I recommend these two as they seemed more stable than others. I got lucky as I managed to squeeze in 15.7gb of data (yes, the limit is 15gb!) but uploads did fail a few times, so keep trying! You can also pay for more storage, which is fairly cheap. I would definitely recommend that you do if you have too many 15GB+ dataset.

Of course if there is a server the Zenodo guys can download your data from, then the first step is unnecessary. Just share the link with the Zenodo team and explain clearly how they can reach and download the dataset.

First Zenodo steps:

Create an account on Zenodo.

Email the Zenodo user support group: info@zenodo.org

In your email, explain to them that you have a series of large dataset you’d like to upload (so I had 6 that needed uploading under the name SophiaBeads Datasets Project, i.e. one DOI). If you require separate DOIs, I suggest you send them separate emails explaining what each item is about (so they don’t mix them up when uploading, or collect them together under one DOI).

Be as descriptive as possible about the files (the links to download them from and how big the file sizes are in size, etc). Once the Zenodo group download your files, they send you the md5 checksum results for each one so you can verify that they have the correct files. Don’t skip this, and make sure that nothing went wrong!

They also send you the DOI and the Zenodo link for your files. They are very quick with this, and after all the uploading problems I had with the cloud storage services, this part went extremely smoothly.

What if you have data less than 2GB in size...

IF you have files less than 2GB in size, you should use the uploading tool on the website (this is probably not the case but still important to keep in mind!)

You can do this by clicking the ‘Upload' tab > 'Choose files…' button > select your data folder.

HOWEVER, if you try to upload a few files <= 2GB at the same time and the uploads fail, leave it and get in touch with the Zenodo team immediately. The first thing I tried was to break my large dataset into subfolders of <=2GB but the uploads kept failing. I repeated the uploading steps and it ended up with their system refusing all user uploads since they have an upload limit of 100GB on their servers (the files are kept here until the Zenodo team approves each project and assigns DOIs) and there were a lot of users uploading material at the time (50GB of that was mine!!) They did say that this limit is something they are working on to improve but I think it is still there.

After the upload:

Once your files are uploaded, they will be listed on ‘Upload' > 'My uploads' section on the right.

Clicking on your submission will take you to the preview of your upload, where at first all the fields will be completely empty. The final step is just filling in the fields on this page and save + submit (please save before you submit your changes!) You can always go back and modify the description of your upload on this page.

-- MartinTurner - 08 Apr 2015

Topic revision: r4 - 05 Jun 2015 - 12:50:26 - MartinTurner
 
This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback