http://www.sei.cmu.edu/feeds/tag/Updates on changes and additions to the SEI Blog for posts matching Testingen-usMon, 17 Feb 2025 00:00:00 -0500https://www.sei.cmu.edu/blog/introducing-mlte-systems-approach-to-machine-learning-test-and-evaluation/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesMachine learning systems are notoriously difficult to test. This post introduces Machine Learning Test and Evaluation (MLTE), a new process and tool to mitigate this problem and create safer, more reliable systems.Alex Derr, Sebastián Echeverría, Katherine Maffey, Grace LewisMon, 17 Feb 2025 00:00:00 -0500https://www.sei.cmu.edu/blog/introducing-mlte-systems-approach-to-machine-learning-test-and-evaluation/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestingMachine Learninghttps://www.sei.cmu.edu/blog/the-myth-of-machine-learning-reproducibility-and-randomness-for-acquisitions-and-testing-evaluation-verification-and-validation/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesA reproducibility challenge faces machine learning (ML) systems today. This post explores configurations that increase reproducibility and provides recommendations for these challenges.Andrew Mellinger, Daniel Justice, Marissa Connor, Shannon Gallagher, Tyler BrooksMon, 13 Jan 2025 00:00:00 -0500https://www.sei.cmu.edu/blog/the-myth-of-machine-learning-reproducibility-and-randomness-for-acquisitions-and-testing-evaluation-verification-and-validation/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesAcquisition TransformationTestingMachine LearningVerificationhttps://www.sei.cmu.edu/blog/redemption-a-prototype-for-automated-repair-of-static-analysis-alerts/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis post introduces Redemption, an open source tool that uses automated code repair technology to repair static analysis alerts in C/C++ source code.David SvobodaMon, 10 Jun 2024 00:00:00 -0400https://www.sei.cmu.edu/blog/redemption-a-prototype-for-automated-repair-of-static-analysis-alerts/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesStatic AnalysisSecure CodingTestinghttps://www.sei.cmu.edu/blog/six-best-practices-for-developer-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesCode coverage represents the percent of certain elements of a software item that have been exercised during its testing....Robert BinderMon, 11 Nov 2019 00:00:00 -0500https://www.sei.cmu.edu/blog/six-best-practices-for-developer-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/dont-play-developer-testing-roulette-how-to-use-test-coverage/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesSuppose someone asked you to play Russian Roulette. Although your odds of surviving are 5 to 1 (83 percent), it is hard to imagine how anyone would take that risk....Robert BinderMon, 14 Oct 2019 00:00:00 -0400https://www.sei.cmu.edu/blog/dont-play-developer-testing-roulette-how-to-use-test-coverage/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/testing-concurrent-systems-concurrency-defects-testing-techniques-and-recommendations/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesConcurrency, which exists whenever multiple entities execute simultaneously, is a ubiquitous and an unavoidable fact of life in systems and software engineering....Donald FiresmithMon, 24 Jun 2019 00:00:00 -0400https://www.sei.cmu.edu/blog/testing-concurrent-systems-concurrency-defects-testing-techniques-and-recommendations/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/enabling-shift-left-testing-from-small-teams-to-large-systems/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesShift left is a familiar exhortation to teams and organizations engaged in Agile and Lean software development. It most commonly refers to incorporating test practices....Nanette BrownMon, 18 Mar 2019 00:00:00 -0400https://www.sei.cmu.edu/blog/enabling-shift-left-testing-from-small-teams-to-large-systems/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesSystem Verification and ValidationTestingAgilehttps://www.sei.cmu.edu/blog/decision-making-factors-for-selecting-application-security-testing-tools/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesIn the first post in this series, I presented 10 types of application security testing (AST) tools and discussed when and how to use them....Tom ScanlonMon, 20 Aug 2018 00:00:00 -0400https://www.sei.cmu.edu/blog/decision-making-factors-for-selecting-application-security-testing-tools/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesCyber MissionsCybersecuritySecure CodingSecurity-Related RequirementsSoftware and Information AssuranceTestingVulnerability AnalysisSecure Developmenthttps://www.sei.cmu.edu/blog/10-types-of-application-security-testing-tools-when-and-how-to-use-them/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis blog post categorizes different types of application security testing tools and provides guidance on how and when to use each class of tool.Tom ScanlonMon, 09 Jul 2018 00:00:00 -0400https://www.sei.cmu.edu/blog/10-types-of-application-security-testing-tools-when-and-how-to-use-them/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesVulnerability AnalysisSecurity VulnerabilitiesTestingCybersecurityCERT/CCSoftware and Information AssuranceCyber Missionshttps://www.sei.cmu.edu/blog/seven-recommendations-for-testing-in-a-non-deterministic-world/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis blog posting describes a number of measures that have proved useful when testing non-deterministic systems.Donald FiresmithMon, 24 Apr 2017 00:00:00 -0400https://www.sei.cmu.edu/blog/seven-recommendations-for-testing-in-a-non-deterministic-world/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesSoftware and Information AssuranceTestinghttps://www.sei.cmu.edu/blog/the-challenges-of-testing-in-a-non-deterministic-world/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis SEI Blog post discusses the challenges of testing in a non-deterministic world, where system behavior may vary even with identical inputs.Donald FiresmithMon, 09 Jan 2017 00:00:00 -0500https://www.sei.cmu.edu/blog/the-challenges-of-testing-in-a-non-deterministic-world/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/the-top-10-blog-posts-of-2015-technical-debt-devops-graph-analytics-secure-coding-and-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis blog post highlights the top 10 posts published in 2015. As we did with our mid-year review, we will include links to additional related resources that readers might find of interest.Douglas SchmidtMon, 04 Jan 2016 00:00:00 -0500https://www.sei.cmu.edu/blog/the-top-10-blog-posts-of-2015-technical-debt-devops-graph-analytics-secure-coding-and-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesDevopsSecure CodingTestingHigh-Performance ComputingTechnical Debthttps://www.sei.cmu.edu/blog/a-taxonomy-of-testing-what-based-and-when-based-testing-types/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis SEI Blog post provides a taxonomy of testing types based on when they are conducted in the software development process and their primary focus.Donald FiresmithMon, 21 Sep 2015 00:00:00 -0400https://www.sei.cmu.edu/blog/a-taxonomy-of-testing-what-based-and-when-based-testing-types/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/a-taxonomy-of-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThrough this series of blog posts, I will also challenge testing practitioners to examine and determine the degree of completeness of their personal testing expertise, experience, and training, and test programs and associated test planning.Donald FiresmithMon, 31 Aug 2015 00:00:00 -0400https://www.sei.cmu.edu/blog/a-taxonomy-of-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/testing-agile-metrics-fuzzy-hashing-android-and-big-data-the-sei-blog-mid-year-review-top-10-posts/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesAs we reach the mid-year point, this blog posting highlights our 10 most popular posts, and links to additional related resources you might find of interestDouglas SchmidtMon, 13 Jul 2015 00:00:00 -0400https://www.sei.cmu.edu/blog/testing-agile-metrics-fuzzy-hashing-android-and-big-data-the-sei-blog-mid-year-review-top-10-posts/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesHigh-Performance ComputingMalwareTestingAgilehttps://www.sei.cmu.edu/blog/four-types-of-shift-left-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis SEI Blog post discusses the four types of shift-left testing and their benefits.Donald FiresmithMon, 23 Mar 2015 00:00:00 -0400https://www.sei.cmu.edu/blog/four-types-of-shift-left-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/android-heartbleed-testing-and-devops-an-sei-blog-mid-year-review/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis SEI Blog reviews the most popular posts for the first half of 2014, and links additional related resources for readers.Douglas SchmidtMon, 30 Jun 2014 00:00:00 -0400https://www.sei.cmu.edu/blog/android-heartbleed-testing-and-devops-an-sei-blog-mid-year-review/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesDevopsAndroidSecure CodingTestingSecure DevelopmentSoftware ArchitectureBig Datahttps://www.sei.cmu.edu/blog/the-importance-of-automated-testing-in-open-systems-architecture-initiatives/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThis SEI Blog post explores how the Navy is operationalizing Better Buying Power to Open Systems Architecture & Business Innovation initiatives.Douglas SchmidtMon, 03 Mar 2014 00:00:00 -0500https://www.sei.cmu.edu/blog/the-importance-of-automated-testing-in-open-systems-architecture-initiatives/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestingCommon Operation Platform Environments (COPEs)Open Systems ArchitecturesSoftware Architecturehttps://www.sei.cmu.edu/blog/using-v-models-for-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesThe verification and validation of requirements are a critical part of systems and software engineering....Donald FiresmithMon, 11 Nov 2013 00:00:00 -0500https://www.sei.cmu.edu/blog/using-v-models-for-testing/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTestinghttps://www.sei.cmu.edu/blog/common-testing-problems-pitfalls-to-prevent-and-mitigate2/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesDiscover strategies to avoid common testing pitfalls and improve product quality during software development.Donald FiresmithMon, 06 May 2013 00:00:00 -0400https://www.sei.cmu.edu/blog/common-testing-problems-pitfalls-to-prevent-and-mitigate2/?utm_source=blog&utm_medium=rss&utm_campaign=my_site_updatesTesting