Data Definition and 998 Threads

Data are units of information, often numeric, that are collected through observation. In a more technical sense, data are a set of values of qualitative or quantitative variables about one or more persons or objects, while a datum (singular of data) is a single value of a single variable.Although the terms "data" and "information" are often used interchangeably, these terms have distinct meanings. In some popular publications, data are sometimes said to be transformed into information when they are viewed in context or in post-analysis. However, in academic treatments of the subject data are simply units of information. Data are used in scientific research, businesses management (e.g., sales data, revenue, profits, stock price), finance, governance (e.g., crime rates, unemployment rates, literacy rates), and in virtually every other form of human organizational activity (e.g., censuses of the number of homeless people by non-profit organizations).
Data are measured, collected and reported, and analyzed, and from data visualizations such as graphs, tables or images are produced. Data as a general concept refers to the fact that some existing information or knowledge is represented or coded in some form suitable for better usage or processing. Raw data ("unprocessed data") is a collection of numbers or characters before it has been "cleaned" and corrected by researchers. Raw data needs to be corrected to remove outliers or obvious instrument or data entry errors (e.g., a thermometer reading from an outdoor Arctic location recording a tropical temperature). Data processing commonly occurs by stages, and the "processed data" from one stage may be considered the "raw data" of the next stage. Field data is raw data that is collected in an uncontrolled "in situ" environment. Experimental data is data that is generated within the context of a scientific investigation by observation and recording.
Data has been described as the new oil of the digital economy.

View More On Wikipedia.org
  1. P

    Can we apply non-linear smoothing to a linear looking like data ?

    My doubt is that whether we can apply non-linear smoothing to a almost linear data ( without one or 2 discontinuity) I have attached the pic in which the red data is the smoothed one. Blue is the original one. I multiplied each point with an increasing like 1, 1.1, 1.2, 1.3, 1.4...so on...
  2. L

    Data analysis: 2D Surface fitting from raw data

    Hey everybody I've got a question for the programming savvy. I'm generating data which can generally be described by.. f(x,y) = Ʃn(an * xn)*Ʃn(bn * yn) Basically what I'm looking at is a data set which shows a surface which looks like about 1/4th of a wonky bowl. My trouble is...
  3. H

    How to store data from an interrupt in C

    It's been a while since I've done some C programming and I can't remember how I should go about implementing this. I have a chunk of memory allocated for storing an array of data. The allocation takes place while the main program is running. The data is being stored to the already allocated...
  4. A

    An algorithm for data compression?

    An algorithm for data compression? I am coming from a philosophy and science background and I'm particularly interested in finding out what a generalised data compression algorithm would look like. (By algorithm I mean something like a flowchart that would show how this process could be...
  5. J

    How to get an entry level job in the Big Data industry?

    How to get an entry level job in the "Big Data" industry? I.e. developing algorithms and crunching numbers for Netflix, Twitter, etc.
  6. marellasunny

    Material on how to go from data to differential equation

    Is there any material or book that explains how one could go from data to differential equation comprehensively? More like functional data analysis+differential equations
  7. N

    Article on New Planck Satellite data

    Universe as an Infant: Fatter Than Expected and Kind of Lumpy http://www.nytimes.com/2013/03/22/science/space/planck-satellite-shows-image-of-infant-universe.html?nl=todaysheadlines&emc=edit_th_20130322the universe may be 13.8 B years old [a bit older than thought] and expanding more slowly...
  8. S

    Large Scale anomaly in Planck data

    Just watching tweets come out of the conference, apparently there is a large scale anomaly that has come out of PLanck . One tweet says challenge to inflation, another says could be pre big bang physics. Obvioulsy I am just reading tweets, so not sure what's real yet. But this could be exciting...
  9. S

    Is it possible to find the SD without the data?

    I have the mean and I have the value at a percentile (99th percentile to be specific). I am just wondering if it's possible to find the SD. Actually, what I am trying to find is the value at the 90th percentile (I think I need the SD to do it, but maybe just maybe there's another method...)...
  10. H

    Help with data from tensile test

    Hi Just got the data from a tensile strength test on a axle we did in school. Before it broke: http://i.imgur.com/1ddrZ7j.png The data : https://www.dropbox.com/s/xf5m8m8gyco561n/data.txt column 1: the displacement in mm column 2: the force in kNI'm supposed to plot a stress strain diagram...
  11. E

    Where can i find Aircraft Flight Data?

    Hi all i am a student doing my thesis on the aircraft performance. However, i am in a need of actual flight data to validate my work. The parameters i am looking at are the range, fuel usage, velocity and altitude. Does anyone know where can i access to those data of any flights or any types...
  12. M

    Where to find sample fluid stirring data?

    I want to find some force data for fluid stirring. originally I intended to record the data using my force sensor, but it doesn't have the resolution to read stirring force for Newtonian fluid. unless there's a Newtonian fluid with high enough viscosity to produce a reaction force greater...
  13. E

    Best tables for data of objects in our solar system?

    I'm writing a program that models objects in our solar system in 3D with lots of functionality. (Senor Project in Computer Engineering), since a lot of time an effort has gone into this software so far, I'd like to implement the most accurate details to configure several objects. By objects...
  14. A

    Do we use these data structures?

    I have seen many data structures like stacks, queue, binary search tree, avl tree etc. Except stack and queue do we actually use these data structure outside the field of computers? Suppose I want to store by books(or any other stuff) according to some priority I would not use a binary heap...
  15. S

    Corrosion data using Electrochemistry

    Hi, I am a Chemical Engineer but a novice in electrochemistry; hence the query might sound very basic to everyone. We have an industrial electrochemical process (With Iron anode) and we are conducting a lab experiment to understand what is the effect of electrolyte pH on corrosion rate of...
  16. B

    How Does a Computer Know When Data Transfer Has Ended?

    Because digital signaling uses an almost instantaneous transition from a set power level to 0W to represent the '1's and '0's of binary data, how does the computer determine when a file has stopped being copied to its storage device? Because even after the signal has stopped being transmitted...
  17. C

    First Post: How to Smooth End point of Finite Data Series time series

    I wish it wasn't out of desperation that I'm making this first post! I have a neural network that is making predictions, the next 5 time points per training. Back testing consists of appending these 5 point sets together to produce a data set that spans time over a much longer period...
  18. M

    Help Needed: Figuring Out How to Make a Linear Graph from Lab Data

    I don't understand what this lab I'm supposed come up with will involve. There's going to be a sound generator producing sound waves. We will have a meter stick and a sensor to measure the sound intensity(W/square meters) and sound level(decibels). We will measure the intensity and level at 6...
  19. L

    Statistics Chi Square test of normally distributed data

    Homework Statement The following data is hypothesized to possesses a normal distribution, is that hypothesis sustained by a Chi-square test at .05 significance: <66...4 67-68...24 68-70...35 70-72...15 72-74...8 >74...4 The Attempt at a Solution 1. I know that I should...
  20. S

    When Will We Know If Planck Discovered B Mode Polarisation?

    In case you didn't know already the first all sky Cmb map will be released at a press conference at ESA HQ March 21st http://smsc.cnes.fr/PLANCK/Fr/GP_actualites.htm This will be followed by a conference to discuss the cosmological data in Holland April 2nd-April 5th...
  21. R

    Hardware based data acquisition systems

    What does hardware based processing mean? ENIAC does hardware square rooting but what is the classification here? Is it like assembly code and C code difference?
  22. S

    MHB Parametric and non-parametric data

    I need the answer of the following question in 500 words. It was set in a university exam. But no where I found the straight forward answer. Please help Question: Differentiate between Parametric and non-parametric data. How these data are analysed? (Word limit 500)
  23. T

    Fortran How to handle empty txt files when reading data in Fortran 90?

    Hi I have a problem with reading data in fortran 90. my programs try to read a txt file that only contains one number in it but if the txt file is empty it stops. i want to make it continue what should i do?
  24. S

    Mathematica Mathematica to FindFit for multiple data set

    After conducting my experimental work I will have a number of sets of data. It is easy to use Mathematica to find a fit of just one set, but I would like to fit all sets at once as they are too many to do them all ate once. They will all be fitted by the same function say y=ax+b, every set...
  25. U

    Triangles, what is the minimum amount of data required to

    With triangles, what is the least amount of data I need before I can start working out other data about the triangle such as angles and lengths of sides ect? I think it is at least 1 length and 2 angles or 2 lengths and 1 angle? What about triangles other than right angle triangles?
  26. A

    Data Mining, not technical books?

    Hi everyone! I just discovered this new branch of statistics/informatics called "data mining", and I was wondering if anyone could suggest me a nice book about it, maybe some not too technical lecture? Otherwise any academic introductory book? What do you think about this subject? Thanks!
  27. H

    Area under the curve of a roll data of satellite

    Dear Members, I would like to ask if we plot the Roll data of a satellite in degrees vs. the time, and if we take the area under the curve of this roll will give something meaningful? Looking forward for your reply. Regards,
  28. C

    Need help manipulating absorption spectroscopy data please

    Hi guys, So my project partner and I are struggling to solve a problem with our laser spectroscopy data for rubidium isotopes and I thought it may be a good idea to see if you could help us. If you take a look at the attached image you will see that the blue line shows our doppler free...
  29. M

    Career Statisticians: Masters in Data Mining Marketability

    I am curious for the opinion of career statisticians on how marketable a Masters in Data Mining would be. I am currently a high school math teacher who has a degree in Economics. In college I had intended to pursue grad studies for statistics and have some SAS programming experience as well as...
  30. N

    Speed and rate of data transfer

    suppose i want to transfer digital signals over 100 meter wire, the loic is implemented using two level, a +5 volts for 1 and 0 volts for logic 0. I want to transfer the data with speed 1000 Mbps which is 10^9 bits per second. now i consider the worst case scenario that my data consist of...
  31. C

    How to find error between non-linear plot and data points?

    Is there a formal way to measure the error between some arbitrary points and a non-linear curve in order to minimize it?
  32. B

    Comparing weighted means in two sets of data

    Homework Statement For simplicity, I'm leaving out extraneous details (like actual numbers). Also, apologies for my formatting; I don't know how to use Latex, but I tried to make this as readable as possible. I have a set of N measurements for τ which each have their own standard deviations...
  33. D

    Mathematica Data from 2nd order ode mathematica

    How can I extract time data from a system 2nd order ODEs in Mathematica?
  34. B

    Probability from a chart of data

    Homework Statement Three people write programs. The following table shows the percentage of codes written by each person (A, B, C) and the percentage of buggy codes for each person. ****************Coder**************** *************A*B*C******************* Percent of code 30 25 45 Percent of...
  35. Y

    Fortran Can Fortran read input data from Excel?

    I have prepared the coordinate of a pipe layout in excel. Now I have to input them into a FORTRAN code. Although I know it is possible to generate these coordinates inside FORTRAN, but working with Excel is much easier for me. Making these coordinate data inside FORTRAN is a very hard work and...
  36. R

    I plotting some data using octave

    Hi, I'm having a lot of trouble finding a tutorial that would allow me to plot a set of data using octave. Everything seems to be teaching me how to plot functions. but say I have a list of data saved in a text file. How do I turn this into an xy scatter? Is this possible using octave? I...
  37. L

    Optimal discretization and expansion order of arbitrary data

    Hi all, I am trying to figure out 1) What to call my problem so I can better research the literature, and 2) see if anyone here knows of a solution. Essentially, I have a large set of f(x) vs x points (~20,000) which I need to split into subdomains in x, and within each subdomain...
  38. M

    Formula required from set of data

    Hi Guys, Im doing my work placement at a steel processing facility and have been asked to derive a formula for quoting purposes that relates to radial bending on a press brake machine, The formula is needed to show the radial pressing increments on steel and the data they have given me is as...
  39. MarkFL

    MHB Michael's question at Yahoo Answers concerning normally distributed data

    Here is the question: Here is a link to the question: Help With A Statistics Problem! 10 Points!? - Yahoo! Answers I have posted a link there to this topic so that the OP may find my response.
  40. B

    Data Analysis: Automating Distribution Comparisons from Daily Stats

    Hey guys, I have a question of how to go about answering a question. I am trying to decide what coding/database language to learn next (most likely SQL with some access thrown in), but have an overall question. I am looking for an application or way to crunch daily statistical updates, then...
  41. I

    Transitioning from Nonprofit management to Data Science?

    Hi all, I am trying to figure out the best way to transition into a new career. I obtained my undergraduate degree in mathematics in 2010. Up until the beginning of my senior year I was determined to go on to do a PhD in pure mathematics. However, I started second guessing myself when I...
  42. N

    Determine ΔE, Q and W for the data in the Table

    Homework Statement The following table gives data, in KJ, for a system undergoing a power cycle consisting of four processes in series. Determine the a) missing table entries, each in KJ, and b) the thermal efficiency. I have attached an image of the Table. Homework Equations Q = (E2-E1) + W...
  43. E

    Matlab - plotting huge amounts of data

    I have a table of 100 data points. I want to plot this on Matlab. Is there any other way for me to do this other than making an array for each column and then plotting it?
  44. A

    Fortran Using FORTRAN to Read & Output Text Data in Column & Row Format

    Hey I have a text file with 2 blocks of Data Example Numbers 1: 1,2,3,4,5,6 7,8,9,10,11 ... Numbers 2: 92,93,94,95,96 97,98,99,100,101 ... How would i use FORTRAN to read the text file and output in a column and row format.. Example 1 92 2...
  45. O

    Does a 3D Half-Edge Data Structure Exist?

    Hello Everyone I'm currently working on a unstructured quadrilateral mesh for a discontinuous galerkin free surface flow model. I use the half-edge data structure in the two dimensional code. Does something like a half-edge or "half-face" three dimensional data structure exist. Otherwise...
  46. U

    Guidelines for reporting raman spectral data?

    I have some raman data that I would like to prepare for inclusion in a report (and possibly publication in archival journal). The author guidelines for journals have not proven helpful in answering whether it is acceptable to perform data manipulations such as background subtraction. It has been...
  47. E

    Quantitative PEMF therapy data please

    I discovered Physics Forums when I searched for PEMF on Google. I became interested in PEMF when I was asked if I could repair two PEMF machines. (I have acquired a reputation as a "Mr Fix-it" in our small community here in Spain!) The first was a small portable device with a hand...
  48. N

    Why modulate the data sinusoid onto a transmitter sinusoid?

    Why modulate the "data" sinusoid onto a "transmitter" sinusoid? (Sorry about the simple question but this stuff isn't exactly my specialty) From howstuffworks.com ... Why can't you just send the sine wave produced by a person's voice directly through the air (or whatever channel you are...
  49. G

    What is the physical form of binary data in a computer processor?

    This a general, layman question. Computer processors work with binary digits, 1 and 0. Of course, computer processors can be seen as microscopic forms of Babbage's analytic engine. So in reality, in the circuits of a microprocessor, what physical form do binary digits take?
Back
Top