Skip to main content

DevOps Testing vs Traditional Testing

Image
By
Appropriate testing is THE differentiator for high performing IT organizations.

What is the Same?

Tests need to be classified according to the attributes of the system or the product that is to be tested.  Test types include:

Unit Test - This is a method that validates that the code statements satisfy assertions.

Static Code Analysis – Testing that checks source code logic and consistency.  Static testing evaluates code against development standards and guidelines. Code execution is not required.

Dynamic Analysis – This type of testing might also be referred to as “Functional Testing”. In this type of test, code is executed against positive and negative functional scenarios.

Code Coverage – Measures the percentage of relevant lines of code tested.

Integration Test – This form of testing will help to determine if code changes work after a code merge.   Integration testing may also be referred to as smoke test, sanity test or build test.

Compatibility Test –  This is used for testing feature interactions.

Conformance Test – This is where we test to ensure the code/product conforms to standards.

Usability – Tests to evaluate the user experience.

Application Testing – Tests to verify the application functions.

Regression Testing – This is required to ensure that changes made did not break something else.

The list goes on to include compliance, security, performance, acceptance testing and more.  Not all test types apply to all products or organizations and the names may be different.

What is Different?

Testing must happen much earlier in the development pipeline and must also take into account all aspects of privacy, security and monitoring. 

Tests are Automated apart from some nonlinear test types requiring human intervention.  Non-automated testing is limited.

Test Environment and Test Data provisioning self-services increase test reliability.

DevOps Tests including pre-flight tests, are performed in an environment that is equivalent to the production environment of customer deployments.  This limits the risk of false positives.

New Thinking for when and how to accelerate change, become a ticketless IT organization and how to provision for skillsets and structures that shatter silos will continue to be integrated into Continuous Testing and the DevOps Pipeline.


DevOps Test Engineering Certification Available!
Labels:

Comments

Post a Comment

Popular posts from this blog

Four Service Characteristics

By
Recently I came across several articles by researchers and experts that laid out definitions and characteristics of services. ITIL provides us with a definition that can help drive the creation of value-laden services: A means of delivering value to customers by facilitating outcomes customers want to achieve without the ownership of specific costs and risks. An area that ITIL is not so clear is in terms of service characteristics. Several researchers and experts put forth that services have four basic characteristics (IHIP): Intangibility—Services are the results of actions not things. They have no physical presence and represent a logical set of elements. One way to think of service is “work done for others.”  Heterogeneity—Also known as “variability”; services are unique items because of the mechanisms used to deliver services, which is people. Because the people element adds variability, the service is variable. This holds true, especially for the value proposition—not eve...
Post a Comment
Read more

What Is A Service Offering?

By
The ITIL 4 Best Practice Guidance defines a “Service Offering” as a description of one or more services designed to address the needs of a target customer or group.   As a service provider, we can’t stop there!   We must know what the contracts of our service offering are and be able to put them into context as required by the customer.     Let’s explore the three elements that comprise a Service Offering. A “Service Offering” may include:     Goods, Access to Resources, and Service Actions 1. Goods – When we think of “Goods” within a service offering these are the items where ownership is transferred to the consumer and the consumer takes responsibility for the future use of these goods.   Example of goods that are being provided in the offering – If this is a hotel service then toiletries or chocolates are yours to take with you.   You the consumer own these and they are yours to take with you.      ...
Post a Comment
Read more

The New Four Ps of Service Management

By
By Donna Knapp For years, people , process , and technology (PPT) was a widely recognized framework for balancing and integrating the components needed to achieve optimal performance and outcomes. In the ITIL v3 Service Design publication, this framework was expanded to the four Ps: people , processes , products , and partners . ITIL 4 has further expanded and evolved this framework to the four dimensions of service management. These four dimensions are collectively critical to the effective and efficient facilitation of value for customers and other stakeholders in the form of products and services. The four dimensions of service management are: Organizations and people Information and technology Partners and suppliers Value streams and processes. These four dimensions represent perspectives which are relevant to the whole service value system (SVS), including the entirety of the service value chain and all ITIL practices. Each ITIL practice is a set of organizational resources base...
Post a Comment
Read more