Machine Learning QA Engineer

Beyond Limits is a pioneering Artificial Intelligence engineering company creating advanced software solutions that go beyond conventional AI. Founded in 2014 with a legacy in space exploration, Beyond Limits is transforming proven technologies from Caltech and NASA’s Jet Propulsion Laboratory into advanced AI solutions, hardened to industrial strength, and put to work for forward-looking companies on earth. We leverage this unparalleled innovation portfolio, along with proprietary cognitive technologies, to help companies solve tough, complex, mission-critical problems and transform their business. We apply a unique hybrid approach to AI, combining numeric AI techniques like machine learning with higher-order symbolic AI and expert human knowledge to deliver intuitive cognitive reasoning and information. Our cognitive computing technology mimics human thought processes and provides explainable reasoning to aid human-like decision-making.Position OverviewBeyond Limits is seeking a resourceful and passionate Machine Learning QA Engineer to grow our Machine Learning team. This role involves designing and implementing test cases, evaluating model performance, verifying data integrity, assessing the robustness of algorithms, and ensuring that machine learning applications meet functional and non-functional requirements. You will work closely with data scientists, software engineers, and other stakeholders to identify potential issues and improve the overall quality and reliability of our machine learning solutions.Job Duties/ResponsibilitiesVerify the quality of input data, ensuring it is clean, relevant, and representative. Define appropriate evaluation metrics based on the specific problem domain & align with the project objectives and stakeholder requirements. Implement robust cross-validation techniques to assess model performance and compare model output with expected results. Evaluate the model for biases that may lead to unfair outcomes for certain groups. Foster collaboration between data scientists, engineers, domain experts, and stakeholders throughout the QA process. Communicate findings, insights, and potential limitations of the ML system effectively to the team. Gather project schedules, software functional and non-functional requirements from our project teams, and turn them into test plans, test designs, and test casesWork closely with stakeholders to setup QA processes and establish best practicesCreate and execute manual & automated testsPerform regression testing to ensure no bugs are introduced in new buildsEstimate, plan and prioritize test activitiesTrack quality assurance metricsWrite test reports for project stakeholdersBe an integral member of the team that follows the Agile software development lifecycle processDebug, troubleshoot, and improve live cloud-based applicationsMinimum Qualifications8+ years of QA experience. Experience in AI (ML/DS) models testing. BS in Computer Science or a related degreeExperience writing test plans, cases, and designs from scratch for large scale distributed applications, web services or RESTful APIsExperience creating, executing and reviewing results of functional, integration, and regression testingExperience with performance, security and/or stress. Ability to design and implement test automation & unit testing frameworks using Cypress, Selenium, Cucumber or Robot Framework. Experience working with JavaScript, Java, Python or a similar programming languagePreferred QualificationsMS In Computer Science or Related FieldComfortable using a variety of tools & technologies to investigate and resolve issues (e.g. SQL, RabbitMQ, Elastic Search, Postgres, Postman, JMeter)Knowledge of Cloud Technologies and Distributed Systems. Experience with AWS/Azure, Docker and container technologies is a solid plusExperience with continuous integration/continuous deployment operations and toolsets (e.g. Jenkins). Beyond Limits provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Beyond Limits complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Beyond Limits expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Beyond Limit’s employees to perform their job duties may result in discipline up-to and including discharge.