Where can I find scientific datasets?

  • Thread starter Borg
  • Start date
  • Tags
    Scientific
In summary, the speaker has been working on database portal projects for the past ten years, but is interested in exploring different types of data, particularly scientific data related to astronomy. They are looking for a hobby that can expand their knowledge and are seeking advice on where to find datasets. Suggestions include checking out the Alaska Borough of Land Management website for lightning and fire data, searching for specific types of data in different places, and visiting a research library. Other helpful resources include asking for recommendations from the user "turbo-1" and checking out the repository for micro-array data. The speaker also notes that they had hoped to find a dump file for easy data import into Oracle, but will likely have to manually structure the tables and import the data."
  • #1
Borg
Science Advisor
Gold Member
2,202
4,543
I've been working on various database portal projects for the last ten years at work that all deal with the same general type of data. I've been wanting to work with different types of data and thought about working with scientific data for a change. I'm mainly looking for a hobby that I can use to expand my scientific knowledge. My general interest lies in astronomy but, I wouldn't limit myself to that if the data were interesting enough.

I'm assuming that there are datasets on the internet that could be downloaded but, I have no idea where to look. Any ideas?
 
Physics news on Phys.org
  • #2
It really depends on what you want. The Alaska Borough of Land Management has a site that they keep their lightning and fire data on (just location and time of each strike/fire).

So if you want that kind of specific data in the particular location, you go to the Alaska BLM web page.

I don't know of any kind of online compendium of all kinds of data. I assume that you'll have to go to different specific places to find different kinds of data, so it won't be an easy hunt.

The best place for a collective of all kinds of data is a research library. My campus has one for bio and one for physical as well as the main library that probably has a lot of data as well.
 
  • #3
If your main interest lies in astronomy, I think that turbo-1 could point you in the right direction. IIRC, he got a paper published based mostly on freely available data in the astronomy community.

Maybe search posts started by him...I think it was a year or more ago that he posted about it...but I am sure that I remember it being him.
 
  • #4
  • #6
Interesting links - thanks very much! I'll check with Turbo-1 as well.

I had hoped that I could find a dump file that I could use to upload the data directly into Oracle but, from these links and my own searching, I will have to manually structure the tables and import the data. Probably not a bad thing anyway.

Edit: I spoke too soon. I see that the micro-array data does have the sql to set up the tables.
I think that I found one of the turbo-1 data links as well https://www.physicsforums.com/showpost.php?p=2441731&postcount=2"
 
Last edited by a moderator:

FAQ: Where can I find scientific datasets?

"What are some reliable sources for finding scientific datasets?"

Some reliable sources for finding scientific datasets include government agencies such as NASA, research institutions, and academic databases like JSTOR and Google Scholar. These sources often provide free access to a wide range of scientific datasets.

"How do I know if a scientific dataset is trustworthy?"

To determine the trustworthiness of a scientific dataset, it is important to consider the source of the data, the methodology used to collect the data, and any peer-reviewed publications that have used the dataset. It is also helpful to look for any potential biases or conflicts of interest in the data.

"Can I use scientific datasets for commercial purposes?"

This depends on the specific dataset and its terms of use. Some datasets may have restrictions on commercial use, while others may be completely open for commercial purposes. It is important to read the terms of use for each dataset before using it for commercial purposes.

"Are there any online communities or forums for sharing and discussing scientific datasets?"

Yes, there are several online communities and forums dedicated to sharing and discussing scientific datasets. These include platforms such as Kaggle, DataCamp, and GitHub. These communities allow scientists to collaborate, share their datasets, and provide feedback on others' datasets.

"Are there any tools or software that can help me analyze scientific datasets?"

Yes, there are many tools and software available for analyzing scientific datasets. Some popular options include R, Python, and MATLAB, which offer various statistical and data analysis capabilities. Additionally, many online platforms, such as Google Colab and IBM Watson Studio, provide free tools for analyzing datasets in the cloud.

Similar threads

Back
Top