What are some of they key things that cause big data projects to fail?
It mostly starts with unrealistic expectations and the wrong people doing the job. Big data is not an extension or the logical extension of data warehousing. It's much more complex. This often creates an ability gap in companies whose big data team is made up of database administrators. This why a data engineer or data scientist is often worth their higher salary. Adding big data to a person’s skill set is not easy and may not be possible for everyone. Data engineers and data scientists already have the skill set. Plus, even for those who are capable of learning these skills, it takes time and resources, which slows momentum on many projects.
Share this Q&A
Tags
Written by Jesse Anderson | Data Engineer, Creative Engineer and Managing Director at Big Data Institute
Jesse Anderson is a Data Engineer, Creative Engineer and Managing Director of Big Data Institute.
He trains and mentors companies ranging from startups to Fortune 100 companies on Big Data. This includes training on current edge technologies and Big Data management techniques.
He’s mentored hundreds of companies on their Big Data journeys. He has taught thousands of students the skills to become Data Engineers. He is widely regarded as an expert in the field and his novel teaching practices.
Jesse is published on O’Reilly and Pragmatic Programmers. He has been covered in prestigious publications such as The Wall Street Journal, CNN, BBC, NPR, Engadget and Wired.
More Q&As from our experts
- What process should a company go through to determine whether big data is a fit for their goals?
- What is the difference between a VPN and a firewall?
- Machine learning algorithm or machine learning model?
Related Terms
- Two-Phase Commit
- Atomicity Consistency Isolation Durability
- Software as a Service
- Stereoscopic Imaging
- Electronic Medical Record
- Computer Telephony Integration
- Electrophoretic Ink
- Web-Based Training
- Reduce, Reuse, Recycle
- Business Blog
Related Articles
VIDEO: 3 Key Breakthroughs That Paved the Way for Artificial Intelligence
Big Data and 5G: Where Does This Intersection Lead?
The 5 Risks of Sharing your Password
MLOps (Machine Learning Operations)
Tech moves fast! Stay ahead of the curve with Techopedia!
Join nearly 200,000 subscribers who receive actionable tech insights from Techopedia.
- Robotic Process Automation: What You Need to Know
- Data Governance Is Everyone's Business
- Key Applications for AI in the Supply Chain
- Service Mesh for Mere Mortals - Free 100+ page eBook
- Do You Need a Head of Remote?
- Web Data Collection in 2022 - Everything you need to know
- How to Protect Microsoft 365 from NOBELIUM Hackers
