Loading…
Thanks for a great Analytics and Data Summit 2019 event. We hope to see you next year Feb 25-27, 2020!
To download the presentations you must first sign up with Sched for free (easy and fast!)
  • Sessions appear in the color of their primary track and can be filtered using Products on the right
  • Use the Search bar for more flexibility
See this link for hints on how to search the schedule


Wednesday, March 13 • 11:10am - 12:00pm
Analyzing binary data in Hadoop

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
While most data analysis is textual, this presentation discusses the use of Java Map-Reduce to extract the metadata from sonar files collected by UUV (Unmanned Underwater Vehicle) missions. The sheer volume of files generated makes this a good candidate for Hadoop divide and conquer. The geolocation and timestamp information is extracted and loaded into a Hive Database, followed by a Sqoop job to transfer the data to an Oracle Database. Oracle APEX (Application Express) is then used to visualize the information on a Google map. The motivation for this effort comes from a prior project that extracted event information from Windows Event logs (using Java Map-Reduce). In addition the depth information is also used with basic AI classification algorithms in Hadoop/Spark for prediction.





Speakers
AA

Abhinav Arya

Student, UC Berkeley
avatar for Arijit Das

Arijit Das

Research Associate, Naval Postgraduate School
Arijit Das is a computer scientist with BS/MS degrees in Computer Science (MNREC, India & Oregon State University) and an MSEE from University of Nevada Las Vegas. He currently is a research faculty at the Computer Science Department of the Naval Postgraduate School in Monterey, California... Read More →
PK

Pyojeong Kim

Student, Naval postgraduate school


Wednesday March 13, 2019 11:10am - 12:00pm
4-Rm 105