Big Data Engagements – Architecture, Technology Reviews and Solutions
Learn about our Big Data engagements and how DesignMind can help your organization make the most of your valuable data. Our experts specialize in a wide range of Big Data analytic technologies.
Architecture Review – 4 weeks
Goal: Review platform, process, tools, and organization to determine if it aligns to your organization’s requirements and industry standard best practices
- Interview architects, users, and other key stakeholders to understand system requirements, known problem areas and areas for further focus
- Review documentation artifacts and/or actual implementation to analyze architecture, design, and implementation (existing and planned) intended to fulfill requirements
- Provide expert knowledge on reference architecture, patterns, problems, and solutions relevant to the big data analytics, data science, and cloud data platform spaces, and ancillary concerns around data security, governance, scalability and usability
- Identify gaps or other areas where the proposed architecture/design fails to meet requirements, poses a risk to data security, etc.
- Document all findings and work with the client team to develop actionable recommendations to align architecture and implementation with requirements, and provide supporting documentation for the project
Platform Optimization – 4 weeks
Goal: Review existing or planned platform to identify and implement optimizations to processes, workflows, and queries to improve velocity and reduce cost
- Provide expert knowledge on reference architecture, patterns and problems/solutions relevant to the big data analytics, data science, and cloud data platform spaces, and ancillary concerns around data security, governance, scalability and interfaces/usability
- Interview architects, users, and other key stakeholders to understand system requirements, known problem areas and areas for further focus
- Review platform health and performance through existing monitoring interfaces, and additional profiling tools/interfaces as needed
- Identify and evaluate opportunities to improve performance, throughput and scalability through system, compute and storage sub-system tuning
- Scope work required for the rollout of recommended changes through production. Optionally deploy changes and measure impact to the system
- Document all findings and recommendations for client team, assist with long-term planning to maintain optimal system health
Technology / Strategy Evaluation and Selection – 4 weeks
Goal: Provide expert knowledge on reference architecture, patterns and problems/solutions relevant to the big data analytics, data science, and cloud data platform spaces, and ancillary concerns around data security, governance, scalability and interfaces/usability
- Interview architects, users, and other key stakeholders to understand system requirements, known problem areas and areas to be improved
- Develop key selection criteria for technology components or strategy. Criteria are aligned with industry standard best practice, but are customized and weighted for the organization’s specific needs
- Will cover functional and non-functional requirements to best uncover show-stoppers, issues that could eliminate solution from the running.
- Identify a short list of candidate strategies and technologies based on solution architect and client experience, and evaluate them against selection criteria following “paper” evaluation methodology (based on product documentation, reviews, etc)
- Execute Proof-of-concept / proof-of-value for the technologies likeliest to meet requirements based on rankings from paper evaluation
- Optional based on time remaining
- Identifying show-stoppers
- Document all findings and recommendations for client team, assist with long-term planning for implementation, rollout, and adoption of strategy/technology
Our consultants specialize in the following platforms: Hadoop (Microsoft HDInsight distributions), Apache Hive and Pig, Apache Spark and Mahout, Apache HBase and Cassandra, Amazon Web Services (Data Pipeline, EMR, Redshift), and Apache Impala and SQL on Hadoop.
Contact us to learn more about our big data engagements, consulting services, and technology expertise.
