Data Definition and 998 Threads

  1. shivajikobardan

    Comp Sci Data Encryption Standard Confusion

    First I'll give some context about how the book's written as many books are presenting it in different ways. Reference: CRYPTOGRAPHY AND INFORMATION SECURITY, THIRD EDITION By PACHGHARE, V. K. Confusions: 1) Why is Expansion Permutation called so? The name sounds very contrary to what...
  2. P

    Data transformations: When do you know to stop?

    I'm running raw data and although, visually, the trends are promising, none of it is statistically significant. I was just going to leave it at that because the data was obtained after only 1 year of the experiment and I was just going to say that if treatment continued for a longer period of...
  3. M

    I Approximate new acorrelation given previous acorrelation and a new set of data?

    Hi PF! The autocorrelation coefficient ##\rho## is defined as $$\rho_k \equiv \frac{\sum_{t=k+1}^T (x_t - \bar x)(x_{t-k} - \bar x)}{\sum_{t=1}^T(x_t-\bar x)^2}$$ Now suppose we calculate ##\rho## through ##T##, but are then given a new data at time ##T + \Delta t##. Is there a way to...
  4. shivajikobardan

    Comp Sci Please give me an example of how any indexing works in big data search

    [Mentor Note -- PF thread and MHB threads merged together below due to MHB forum merger with PF] I have to learn in context of lucene, but firstly, I want to learn the example indexing in general. Sth like this-: And I am not getting any google books and pdfs to learn about these topics. I...
  5. Arman777

    Creating a grid type 3D data array from data points

    I have a 3 data column ##(X, Y, Z)## ranges from ##(min, max)##. For example, ##X = (0, 5)##, ##Y=(0, 3)##, ##Z=(0, 2)##. By using them I need to create a numpy array in the form of ##[(0, 0, 0), (0, 0, 1), (0, 0, 2), (0, 1, 0), (0, 1, 1), (0, 1, 2), (0, 2, 0)...]## So in total there will be...
  6. Swamp Thing

    Google docs etc: is the data transfer secure?

    This video ... ... At around 01:26 they say that data to and from the Google apps server goes across unencrypted. Is that true, given that all these services are necessarily over HTTPS ? On a related note, does a VPN layer add any value in terms of data security, above that provided by HTTPS ?
  7. DaveC426913

    Tornado path visualization - what is this data?

    Does anyone have a clue what the gold points and associated lines represent? I notice that all the gold lines form closed loops (so they're not travel paths) and they cross themselves (so they're not contours). I can't think of any type of data that would result in this. I've tried to follow...
  8. M

    MATLAB Can't get tutorial to work with new data

    Hi PF! I'm going through a backtracking tutorial here. That code runs well for me, and is below: %% LOAD DATA % Read a table of daily adjusted close prices for 2006 DJIA stocks. T = readtable('dowPortfolio.xlsx'); % For readability, use only 15 of the 30 DJI component stocks. assetSymbols =...
  9. M

    MHB Calculate Data Points to Match Given Totals

    Hello! I have a super tricky problem for everyone I truly hope there is an answer to this. I have different data sets all of which are a different amount of number per set (total points per set) Each number is multiplied by 4.86 then rounded down. Then the total is added Alternatively the sum...
  10. M

    MATLAB How to load data from the example supplied on MATLAB website?

    The demo here doesn't specify how to download the file dowPortfolio.xlsx from the first line in the tutorial: T = readtable('dowPortfolio.xlsx'); Any help here (please tell me it's not just me)? Nevermind, evidently you literally can just copy that line into the command window and MATLAB...
  11. DaveC426913

    Raw genetic data: Plink and TPED file

    Well I just checked out my boy's breed of dog. Not what we expected...But the analysis came with some raw data, 200,000 base pairs on ... 41 chromosomes. They're in a .TPED file, which can be opened in Excel. Apparently, it an also be analyzed using PLINK software. Wondering what I can do to...
  12. M

    A Linear combination of data with uncertainty

    Hello! I have 2 measured data points (they are measurements of different observable, not 2 measurement of the same observable), with quite different errors, say ##x_1 = 100 \pm 1## and ##x_2 = 94 \pm 10##. I want to compute the value (and associated uncertainty) of a linear combination of them...
  13. JD_PM

    MATLAB How to plot flow data from an orifice in MATLAB without overlapping the plots?

    I am studying a flow going through an orifice. I am aimed at overlapping the plots for the speed distribution over the vertical width profile (which is 0.015 m long; highlighted in red) for two downstream, horizontal distances [w.r.t. the orifice]: 0.01 m and 0.03 m. The result should look...
  14. A

    Data sources for Vehicle Dynamics Model validation?

    Hello all, I have written a VDM for my Masters thesis, unfortunately, since I am from a discipline other than mechanical engineering I don't have access to reliable validation material or a way to produce it (moreover, we don't have an actual vehicle testing lab/area at the U that I know of)...
  15. J

    Data Breach: XYZ's Privacy/Legal & Ethical Considerations

    If a company has a data breach what are the privacy/legal and ethical factors that the business has to take into consideration? Researching I've seen that most laws require disclosure of the data breach if it contains personal information. EU laws are the most strict. Failure to disclose...
  16. M

    What data can we use to help evaluate Russian biowarfare allegations?

    For a week I've been seeing Russian allegations that the U.S. was researching bioweapons in the Ukraine. Today's example specifically targets a company, Metabiota. To be clear, I have seen nothing persuasive so far, for the following reasons: Metabiota's entire role is to track emerging...
  17. N

    GPS receiver data transfer using RF transmission

    Hi all I want to develop a miniature system using GPS receiver, a micro-controller, an RF transmitter and its receiver. The idea is to acquire lat/long of buoy dropped in sea which is equipped with miniature GPS receiver (with associated circuitry) which can send its position (lat/long data) to...
  18. shivajikobardan

    Comp Sci Cold Start & Early Rater: Making Predictions with Limited Data

    cold start-: system requires huge amt of current user data to make accurate predictions early rater-: new user hasn't rated many items to make predictions. both same? isn't it?
  19. M

    I How to find Heliocentric latitude data for each planet?

    Does anyone know where to find information (or software or calculator) able to show on which days / time (2021) where Mercury (and other planets) are as low/high as possible on the heliocentric latitude For example: like the animation seen in the link below. The problem with this site is that...
  20. anorlunda

    NTSB Accident Report, Data Entry Error

    On September 8, 2019, the 200m long vehicle carrier ship Golden Ray (carrying 4067 Kia, Chevrolet, GMC, GM, Mercedes-Benz, and Ram vehicles) capsized in St. Simons Sound, Georgia, USA The accident caused the loss of a $62 million ship, $142 million in lost cargo, and $250 million in salvage...
  21. chwala

    Data transfer from MS Excel to PSPP

    Homework Statement:: See attached Relevant Equations:: analysis stats Find below a sample of the data that i want to import onto spss; My intention is to have the data appearing as one variable only on PSPP. This is how it appears on PSPP; It defaults as 5 variables, ...i used comma...
  22. shivajikobardan

    Comp Sci Why is distributed computing/system important/necessary for big data?

    What is 1 example of use of distributed system in big data? Here are the notes in my college curriculum, which I of course understand but it doesn't make clear what is the role of distributed system in big data-...
  23. shivajikobardan

    MHB Unravelling the Role of Distributed Systems in Big Data

    Here are the notes in my college curriculum, which I of course understand but it doesn't make clear what is the role of distributed system in big data-...
  24. shivajikobardan

    MHB What are structures of big data?

    I am learning about 3 V's of big data. I am learning about variety at the moment. They say variety represents variety of formats, data sources and structures. I understand format might be txt, audio, video files etc. Sources might be different sources of data. But what is structures of data?
  25. shivajikobardan

    Comp Sci What are structures of big data?

    I am learning about 3 V's of big data. I am learning about variety at the moment. They say variety represents variety of formats, data sources and structures. I understand format might be txt, audio, video files etc. Sources might be different sources of data. But what is structures of data? I...
  26. D

    Data storage using microtubules?

    Can the microtubule, due to its symmetry and conservation laws (Noether’s theorem), be a good candidate for data storage?
  27. soniajessi

    Other Is Data Science a good career Choice?

    Is data science in demand? Is data science hard? How many hours do data scientists work? Is it hard to find a job as a data scientist?
  28. F

    I Double Pulsar: 16 Year Study Validates Relativity

    I'm not sure if this belongs to astronomy or GR. But as it - once again - proves Einstein right, I posted it here for all who need another paper to conquer all who doubt. And I think it is an interesting paper (53 pages), at least from my layman's point of view...
  29. Haorong Wu

    I Any tools that can help find the equation for a set of data?

    Suppose that I can generate the result of a function ## c_{x,y}=f(x,y)## by a method not involving the function ##f##. I need to find ##f(x,y)## now. The expression of ##f(x,y)## is expected to contain basic algebra operation (+-*/), power, absolute value and factorial. I have tried to find it...
  30. W

    A Choice of Pipelines for Data Analysis

    Hi, So say I have some data to process. I am trying, say, Linear/Multilinear Regression. I know how to do this within Python Pandas. I can learn how with Tensorflow (TF). Would TF produce the same output given the "right" choice of Activation Functions *? Or would it output a model that is...
  31. C

    I Finding a Rational Function with data (Pade approximation)

    Dear Everybody, I need some help understanding how to use pade approximations with a given data points (See the attachment for the data). Here is the basic derivation of pade approximation read the Derivation of Pade Approximate. I am confused on how to find a f(x) to the data or is there a...
  32. chwala

    Finding the skewness and Kurtosis of grouped data

    See the grouped data below; I just want to be certain that i have followed the correct step in trying to find skewness of the grouped data.
  33. A

    MCNP Output Data: Tutorials & PDFs for SCWR Criticality Analysis

    Hi, Is there any tutorial or pdfs that can help me with the MCNP output data? I'm working on the criticality of the SCWR, and I designed the fuel assembly and run it on the MCNP, but I have no idea about data extraction.
  34. H

    World Data Storage: How Much Did 2TB Equal in the Past?

    I bought a thing the size of a pack of cigarettes that holds 2 terabytes. My question is, in what year was the total electronic data storage of the entire world equal to 2 terabytes?
  35. M

    Boffins use nuclear radiation to send data wirelessly

    https://www.theregister.com/2021/11/15/wireless_information_transfer_with_fast_neutrons/ https://www.sciencedirect.com/science/article/pii/S0168900221009013 Not sure there are any practical uses, but interesting none the less...
  36. gxa

    Finding Peak Values & Calculating Efficiency from Energy & Count Data

    At the end of the measurement I made with a detector, I only have the energy and count values as in the attached excel file. How can I find the peak values with the data I have and calculate the efficiency?
  37. D

    How to automate tests on a physical model without real data

    I want to code up a (physical) model of an aircraft or car, and I want to create an automated integrated test to check that the code produces reasonable and realistic results. For example, I want to check that the path taken by the aircraft or car is physical and reasonable. However, I don't...
  38. S

    Cellular or smartphone calls / texts / data when on a moving train

    Do smartphone users get good cellular service as well as good cellular data while on a moving passenger train? This is assuming no wi-fi available.
  39. A

    B It works but why? (Matching experimental data to a random equation)

    Hey guys, I've about a week left to submit my final paper for my trade degree in transportation. The paper is about an analysis of potential implementation of an electric car for direct deliveries in my area where I live. In part of it, I try to analyze how many possible trips a car like...
  40. jedishrfu

    The Data Science of Elizabeth Bik Unmasks Hydrochloraquin

    An article of data scientist Elizabeth Bik and her efforts to unmask the bad science surrounding Hydrochloraquin https://www.buzzfeednews.com/article/stephaniemlee/elisabeth-bik-didier-raoult-hydroxychloroquine-study and some biographic info on Dr Bik: https://en.wikipedia.org/wiki/Elisabeth_Bik
  41. ohwilleke

    I New Lepton Universality Data To Be Announced Tuesday, 18 October 2021

    One of the Standard Model's rules is that charged leptons (i.e. the electron, muon and tau lepton) are identical to each other in their properties except for their masses (and that their anti-particles are identical to them except for a charge-parity flip). But, in two kinds of rare...
  42. yucheng

    I Stromgren photometric data in Vizier

    I would like to try the photometric transform given in my book, for instance ##V = y - 0.12[(b-y) - 0.55]^2##, however, the two catalogs I've consulted, Paunzen, 2015 and Hauck, 1997 only provides the indices. Do these catalogs provide the uvby magnitudes as well, just hidden somewhere? Are...
  43. f95toli

    Storing device parameter data for a measurement system

    We are working on new software for one of our measurement systems (written in Python). The new system is capable of measuring more devices simultaneously than before so keeping track of what we are doing is important; it will also be more automated. One of the things we want to implement is...
  44. PainterGuy

    European data relay satellite system

    Hi, I was watching the following video. So, a low Earth orbit continuously transmits data to a geosynchronous satellite via a laser link. The geosynchronous satellite relays the data to a ground station on Earth via a radio link. In case of European Data Relay System (EDRS) laser communication...
  45. LCSphysicist

    Solving Uncertainty in Data Analysis with Spectrophotometry

    So i have a folder with a lot of data/information. Basically what i have is approximatelly 2k 2upla of x and y, because i need to find the function that describe the behavior of these data. Of course, i can use a program/software to fix/adjust the curve using the concept of OLS... BTW. The...
  46. J

    I How well do cosmological models explain the observed µ vs. z data?

    The following figure shows observed distance modulus (µ) vs. redshift (z) data (references of data sources are available): How well do cosmological models, such as ΛCDM and models based on non-expanding universe, explain these observed data? For explanation of terms, please see, Type Ia...
  47. W

    Principal component analysis and data compression in Machine Learning

    I wonder how to accurately perform data compression on the m x n matrix X using PCA. Each row is a data point, and each column is a feature. So m data points with n features. If I like to go k < n dimensions, how is the correct way of doing so? How to I accurately create the matrix W_k, which...
  48. T

    Engineering Data Science applied to Aerospace Engineering without AE background

    Apparently, DS can be applied to the Aero industry, but how is a question that I still can't find an answer, and which proves to be incredibly elusive online. I don't mean the Business Intelligence positions, I want to get more involved with the engineering team. Can a Data Scientist be useful...
  49. M

    MHB Calculating statistical values from given data

    Hey! :giggle: Analyst has collected the following data on the performance of the $X$ stock for $10$ different years. a) Calculate the arithmetic mean, the median, the mode, the standard deviation, the coefficient of variability and of asymmetry. You interpreted your results. b) Does the...
Back
Top