Big data Definition and 17 Threads

  1. AmericaPacific42

    Algorithms for quadcopters to use back-EMF to detect obstacles close?

    Would it help to study Verilog (VHDL) or Field-Programmable-Gate-Arrays (FPGA) if self-crafted x64/aarch64-assembly would take too much power/be too slow?
  2. shivajikobardan

    Comp Sci Please give me an example of how any indexing works in big data search

    [Mentor Note -- PF thread and MHB threads merged together below due to MHB forum merger with PF] I have to learn in context of lucene, but firstly, I want to learn the example indexing in general. Sth like this-: And I am not getting any google books and pdfs to learn about these topics. I...
  3. shivajikobardan

    Comp Sci Why is distributed computing/system important/necessary for big data?

    What is 1 example of use of distributed system in big data? Here are the notes in my college curriculum, which I of course understand but it doesn't make clear what is the role of distributed system in big data-...
  4. shivajikobardan

    MHB Unravelling the Role of Distributed Systems in Big Data

    Here are the notes in my college curriculum, which I of course understand but it doesn't make clear what is the role of distributed system in big data-...
  5. shivajikobardan

    MHB What are structures of big data?

    I am learning about 3 V's of big data. I am learning about variety at the moment. They say variety represents variety of formats, data sources and structures. I understand format might be txt, audio, video files etc. Sources might be different sources of data. But what is structures of data?
  6. shivajikobardan

    Comp Sci What are structures of big data?

    I am learning about 3 V's of big data. I am learning about variety at the moment. They say variety represents variety of formats, data sources and structures. I understand format might be txt, audio, video files etc. Sources might be different sources of data. But what is structures of data? I...
  7. G

    Big Data and a Saturation Point

    I ask this with more of a software background than an engineering background, but here I go anyway. Big data is arguably the cultural motif or monograph of the information age. Trends involve immersing ourselves in media of various sorts and processing them at exceptional rates. Of course...
  8. astroman707

    For astronomers, what software/languages do you use to handle data?

    For all the astronomers and astrophysicists out there, what are your preferred methods of dealing with large swaths of data? What are your go to programming languages, and software?
  9. jedishrfu

    How Can DNA and Big Data Be Used to Find You?

    https://www.vox.com/science-and-health/2018/10/12/17957268/science-ancestry-dna-privacy
  10. Chronos

    I Using big data to identify astronomocal data bias

    I've been following, albeit loosely, the use of big data to refine astronomical data. It has been frequently noted that astronomy is an excellent test ground for big data approaches. I'm led to wonder what kind of results have been achieved to date and how effective are these methods for...
  11. EnumaElish

    Physicists set to revolutionize big data, AI

    When I opened up the article https://www.wired.com/2017/01/move-coders-physicists-will-soon-rule-silicon-valley/ I expected to see quantum computing as the next field physicists are to revolutionize. I was surprised to see it was data management and machine learning. I am happy for physicists...
  12. B

    Math Career Advice -- Wanting to become a data scientist

    Hi, so currently I am stuck in a situation where I currently accepted a job offer and had 5 other interviews which I never heard back from any yet. (I will have to say no if I hear back I guess and there was one I really was hoping to get but its going to be too late now). These were for data...
  13. W

    Big Data and RDBS (Relational DB). Do They Fit?

    Hi All, I am having trouble seeing how Relational Databases (RDBS) can be used in the world of big data. The inflow of data seems to be way too fast for the database to reflect what is going on at a given moment. I understand this issue is supposed to be addressed by data warehouses. Is...
  14. A

    Big Data in Physics: Quantum Mechanics/Particle Physics for Undergrads?

    I am an undergraduate physics major and I am taking a course on Big Data analytics. For the semester project, our professor has asked up to take up any field that interest us and do a project in that. I want to do something related to quantum mechanics or particle physics. Is that possible at my...
  15. A

    How to interpolate big data with small deviation?

    Hi, I've got a problem. There is over 9 milions points in my .txt. I have to find polynom for surface of this points with deviation smaller then 0.01 (x [-3:3], y[-3,3], z [-9,9]). I try many functions in Matlab, but no answer. Thank for help. B
  16. J

    How to get an entry level job in the Big Data industry?

    How to get an entry level job in the "Big Data" industry? I.e. developing algorithms and crunching numbers for Netflix, Twitter, etc.
  17. zoobyshoe

    Right to Big Data: Corporate Control or Equal Access?

    The Right to "Big Data." "Troves of Personal Data, Forbidden to Researchers" The issue is that not every scientist is allowed access to "big data". Also, as it says in the first quote, there is no way to check on the papers based on exclusive-access "big data". They might well be...
Back
Top