B2C Data Migration to B2B Schema, Delta Service Integration, and Test Case Development

Project scope
Categories
Data modelling Software development DatabasesSkills
test suite mocha (javascript framework) jest (javascript testing framework) data extraction code coverage test execution engine postgresql codebase python (programming language) service developmentThis project focuses on migrating the B2C app into the existing B2B system to onboard it as a client. It also involves identifying and integrating any delta services in the B2C app that are missing in the B2B architecture. Finally, the project aims to improve test coverage for the B2B monolith, ensuring a robust foundation for future enhancements.
Project Scope:
Part 1: B2C Data Migration
- Analyze Existing B2C Data:
- Compare the B2C database schema with the B2B schema to identify gaps or differences.
- Collaborate with the internal team to define transformation rules for mismatched fields (e.g., converting 1/2 to PASS/FAIL).
- Prepare Transformation Rules:
- Use mapping documents to implement field-level transformations.
- Create scripts or workflows to standardize and validate data during migration.
- Data Migration Execution:
- Extract and transform the B2C data using predefined rules.
- Load the data into the B2B system’s database.
- Validate the migrated data to ensure correctness and completeness.
- Post-Migration Testing:
- Verify seamless integration of the B2C data within the B2B system.
- Ensure B2C functionality aligns with the transformed data.
Part 2: Delta Service Identification and Integration
- Identify Delta Services:
- Perform a detailed comparison of the B2C app’s features and services with the B2B system.
- Create a list of services or functionalities that exist in the B2C app but are missing in the B2B system.
- Integrate Missing Features:
- Implement the delta services within the B2B monolith codebase.
- Ensure the delta services are built in a way that benefits all B2B clients.
- Testing and Validation:
- Test the integrated delta services to ensure functionality and alignment with the B2B architecture.
- Confirm that the newly added services do not introduce regressions or compatibility issues.
Part 3: Test Case Development
- Understand B2B Codebase:
- Work with the internal team to identify critical business logic and services requiring tests.
- Prioritize areas of the B2B monolith for improved test coverage.
- Develop Test Cases:
- Write unit, integration, and functional tests for the B2B system, including the newly added delta services.
- Focus on testing key workflows, such as user management, data processing, and business logic.
- Set Up Testing Environment:
- Use existing CI/CD pipelines to automate test execution.
- Ensure tests run reliably in staging and production-like environments.
- Improve Test Coverage:
- Measure and track test coverage for the B2B monolith.
- Address gaps in test coverage, particularly for core functionalities and newly integrated delta services.
Deliverables:
- Data Migration:
- Successfully migrated B2C data into the B2B schema.
- Scripts or workflows for data extraction, transformation, and loading.
- Validation reports confirming data accuracy.
- Delta Services:
- A documented list of delta services and their integration into the B2B system.
- Functional and tested implementations of the delta services.
- Test Cases:
- Comprehensive test suite for the B2B monolith, covering core services and newly integrated delta features.
- Detailed test case documentation and coverage reports.
- Documentation:
- Migration process documentation, including transformation rules and scripts.
- Delta service integration details and implementation notes.
- Test case documentation for future reference and maintenance.
Technologies and Tools:
- Data Migration: Python/Node.js for ETL scripts, SQL for transformations, PostgreSQL for database interactions.
- Delta Service Development: Node.js, NestJS, or other frameworks depending on the stack.
- Testing: Jest, Mocha, Pytest, or equivalent frameworks.
- Documentation: Confluence, Notion, or Markdown-based guides.
Expectations from Developers:
- Work closely with the internal team to implement data migration and service integration.
- Ensure accurate identification and seamless integration of delta services.
- Write maintainable and modular test cases to improve overall code quality.
- Deliver comprehensive documentation for all processes.
Evaluation Metrics:
- Data Migration:
- Successful onboarding of the B2C app as a B2B client with no data discrepancies.
- Delta Services:
- Fully functional integration of B2C-specific delta services into the B2B system.
- Validation of delta services with no regressions introduced.
- Testing:
- Measurable improvement in test coverage for the B2B monolith.
- Successful execution of all new tests in the CI/CD pipeline.
Providing specialized, in-depth knowledge and general industry insights for a comprehensive understanding.
Sharing knowledge in specific technical skills, techniques, methodologies required for the project.
Direct involvement in project tasks, offering guidance, and demonstrating techniques.
Providing access to necessary tools, software, and resources required for project completion.
Scheduled check-ins to discuss progress, address challenges, and provide feedback.
About the company
Our company is building a wealth-tech SAAS platform. We have a strong founding team comprised of ex -Amazon Business, and engineering team, and relevant educational background across business (Wharton- CEO), Finance(UofT -CTO), Design Head (MIT- head of customer experience)