Archives pour l'étiquette test

Jamkey press review – February 2016

Dear followers, devops-hidden-ally-velocityconf-ux-devops-empathy-1-638

 

here is the 11th « Technical News » of Jamkey, which is mainly press review around Continuous Integration, development and DevOps tooling.

As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on Web development, build tools, architecture (API design) but also methods and processes (like DevOps).

 


Gitlab explained their strategy and delivered a 8.4.4 version of their open source forge.


Backelite provide a first version of a new Sonarqube free plugin to analyse Swift code.


You will find also comparisons on AngularJS 1 and AngularsJS 2

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

 

Devops

SCM

Jenkins

Sonar

Nexus

Web

Mobile

Agile

Cloud

Architecture

Technical test strategy

test-tubeAutomated test strategy is one the key factors of technical tests. Its visibility make the tests part of the development process.Without goals, roles, tools, requirements, scheduling… the automated tests are forgotten deep in the versioning system…

As written in the ISTQB Exam Certification:

The choice of test approaches or test strategy is one of the most powerful factor in the success of the test effort and the accuracy of the test plans and estimates. This factor is under the control of the testers and test leaders.

By describing, managing and tooling-up the different automated tests you will define your strategy.

This global strategy page gives main clues to manage your technical test strategy.

To have a relevant test strategy make it visible.

 

What is a test strategy?

A test strategy is an outline that describes the testing approach of the software development cycle. It is created to inform project managers, testers, and developers about some key issues of the testing process. This includes the testing objective, methods of testing new functions, total time and resources required for the project, and the testing environment.

Test strategies describe how the product risks of the stakeholders are mitigated at the test-level, which types of testing are to be performed, and which entry and exit criteria apply.

They are created based on development design. System design is primarily used and occasionally, conceptual design may be referred to. Design documents describe the functionality of the software to be enabled in the upcoming release. For every stage of development design, a corresponding test strategy should be created to test the new feature sets.

The test strategy describes the test level to be performed. There are primarily three levels of testing: unit testingintegration testing, and system testing as you can read in the Automated test classification.

In most software development organizations, individual testers or test teams are responsible for integration and system testing when dealing withfunctional behavior. Here we speak more of Acceptance tests or Functionnal tests (for example based on HP QC and executed with UFT (ex QTP).

The developers and test experts are responsible for automated tests on unit testing, integration testing, system testing.

Test classification

The automated tests should first be classified in order to be used and integrated into a industrialized process. Please look at the test classification page: Automated test classification

test-classification

Lack of test strategy issues

The common issues with automated tests are not associated to technical problems or the choices of tools, but resides especially in its non-visibility.
When the added value of technical tests is not visible, the organisation will give advantage on more « quantifiable tests » (like functional tests or performance tests) and give-up on technical ones (unit, integration…).

For example, the functional tests are easily quantifiable: dedicated “testing” teams, based on the requirements, test plan in QC, instrumentalisation by UFT (ex QTP) by VB script.
This way, it is easier to give budget to: handle, manage and implement functional tests.

Technical tests remain with the costs of the developers. Because very often, one will say the developers “will make the unit tests” but without real requirements or strategy.

 

Agile projects and using the BDD reverses this trend by bringing closer the Dev and Test teams. Especially when requiring the developers to implement the acceptance tests.

By making the technical tests part of the test strategy, we will improve their development requirements and make them more relevant.

 

Set up a test strategy

The goals to define a test strategy are the following:

Goals

  • Application coverage objectives
  • Set-up a test maintenance plan
  • Have a source code health feedback
  • Use tests as delivery acceptation
  • Verify features non-regression
  • Maintain source code knowledge

Automated test strategy steps

Step
Description
Define Scope and Technology
  • Define perimeter to test (Backend, Front, Data, Integration, Middleware…
  • What technology is involved (Java backend, Java Web, front JS, Mobile iOS…)
  • Roles and Responsibilities of test leader, individual testers, project manager
Define Test Approach

Choose by what type of test starting

Use Test classification

  • Unit Testing
  • Integration Testing
  • System Testing

What relevant coverage is expected ?

What test volume is expected ?

Choose a test development methodology
  • Technical requirements
    • Requirements specifications
    • Requirements traceability matrix
  • Test priorities
    • While testing software projects, certain test cases will be treated as the most important ones and if they fail, the product cannot be released.
  • Choose methodology (eg.: BDD)
  • Batch mode execution
  • Execute in continuous integration
  • Execution scheduling
    • A test plan should make an estimation of how long it will take to complete the testing phase.
  • Mock policy
Identify risks and mitigation
  • Risk occurence anticipation :
    • Any risks that will affect the testing process must be listed along with the mitigation
Define Test environment
  • Hardware requirements
  • Middleware requirements
  • Workstation needs
  • Environment provisioning
Choose Testing tools
  • Test framework which suit development technologies
  • Test orchestration
  • Integration with continuous integration
  • Integration with delivery process
  • Tests record and reporting
Define Execution and release control
  • Execute automated tests plan according to release control
  • Use test plan to validate release
  • Use test plan in a promotion process
  • Regression test approach
    • Regression tests will make sure that one fix does not create some other problems in that program or in any other interface
Defect reporting and tracking
  • How the test result is reported
  • Change and configuration management

 

Set-up Reviews and updates
  • Review the test strategy after milestones
  • Update the test strategy according to feedbacks

Test strategy life-cycle

test-strategy-life-cycle

(Test Strategy in STLC)

 

Jamkey press review – January 2016

Dear followers,

here is my 10th « Technical News » which is mainly press review around Continuous Integration, development and DevOps tooling.

As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on Web development, build tools, architecture (API design) but also methods and processes (like DevOps).

 

A focus on Gitlab project, which deliver new versions almost every 3 days!


AngularJS v2 beta is out, with a lot of improvements. It is still possible to give feedback to the team through GitHub.


Android Studio v2 preview is out with improvements on the emulator.

 

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Gitlab

The Gitlab project deliver almost every 3 days a new version.
And a new version is set of various distributions : CE and EE version, Linux EL6 and EL7…
Here they explain how they deliver and how they manage their roadmap.

Web

Google is preparing the delivery of AngularJS v2 which bring lot of features.
The beta version available allow to test it.

Mobile

Google has delivered a preview of the Android Studio v2.
Lots of performance improvements and a more useful Android Emulator.

Build

The build links are mainly on Gradle which become more and more the main build tool for Java development.

Jenkins

How to setup a continuous delivery pipelin in Jenkins.

Sonar

Agile

Cloud

Architecture

IT Press review – December 2015

Dear followers,

Logo_Apple_Swift
here is the 9th « Technical News » of Jamkey, which is mainly press review around Continuous Integration, development and DevOps tooling.

As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on Web development, build tools, architecture (API design) but also methods and processes (like DevOps).

 

 
Apple announce Swift open source and a 3.0 version with a package manager


The story of Instagram development from Mike Krieger point of view.


A clear description of the Security Vulnerability which affect the Apache Commons components.

And link to that a new Jenkins releases with important security fixes : the Apache Commons patch.


An interesting article comparing Angular 1 vs. Angular 2.


An interesting article on the decline of Java application servers when using docker containers

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Architecture

Stories

DevOps

Jenkins

SCM

Sonar

IDE

Web

Mobile

Agile

Cloud

IT Press Review – October 2015

Dear followers,GitLab-logo2

here is the october « Technical News » which is mainly press review around Continuous Integration, development and DevOps tooling.

As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on Web development, build tools, architecture (API design) but also methods and processes (like DevOps).

GitLab 8 is out, with a new UI and new features. As usual the GitLab team still releasing almost every weeks a new version of GitLab. Be careful to stay in tune with this major new version.

HP LeanFT is released and will replace HP UFT according to HP. More oriented to Agile and BDD testing.

There is a proposal from the Jenkins team to switch to version 2.0, with a new UI and design

Internet Explorer pre 11 versions will not be supported anymore since January 2016 : this is the end of a major story!

On the Mobile side, WatchOS 2.0 and iOS 9 are out, with new features on Unit Testing!

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Build & SCM

DevOps

Jenkins

Sonar

Web

Mobile

Agile

Cloud

Architecture

IT Press Review – July 2015

open-container-project-big

Dear followers,
here is the 6th press review of Jamkey, which is mainly press review around Continuous Integration, development and DevOps tooling.

As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on tools (like JHipster), architecture (API design) but also methods and processes (like DevOps).

This press review focus on development tools, and cloud with the Spring Boot 1.3 release and powerful integration with devtools and Docker and CoreOS unite to start the Open Container Project and standardize runtime, image format.

Geneva SonarQube Conference will take place the 23 & 24 of Spetember.

Facebook Infer bring open source static analysis to mobile Objective-C and JS developments.

Interesting article on the « Release Manager » role, which is often the invisible hero of development projects.

Google is setting up a GitHub rival : Google Cloud Source Repositories
Still lot of news on Jenkins, Sonar, Nexus. And also articles around Micro-Services and Cloud.

 

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.

Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Development tools

GitLab

Web

DevOps

Mobile

Agile

Sonar and Static Analysis

Jenkins

Nexus

Java

Cloud

Misc

IT Press Review – June 2015

WebComponentsPolymerDear followers,

This press review focus on Web development with the release of Google Polymer the WebComponent framework of Google.

Swift (Apple programming language) version 2 is released …. on Open Source !
Angular 1.4 is out, with lots of new features!
Still lot of news on Jenkins, Sonar, Nexus.
And also articles around Micro-Services and Continuous Delivery.

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Web

DevOps

Mobile

Agile

Sonar

Jenkins

Nexus

Testing

Architecture and languages

IDE and Dev Tools

Cloud

IT Press Review – may 2015

Dear followers,
This press review focus on Devoxx France 2015 feedbacks. Devoxx France is a set of conferences for developers which took place in Paris during 3 days in April 2015.
You will find also a new Cloud part which focus on new Cloud tooling and companies strategies.
A new part also on Architecture and Design which provide articles on API, micro-services, Java containers, Open Sources…
There are a lot of new articles on Build tools, mainly on Gradle.
The Java section mention also the end of Java 7 support by Oracle and the announcement on Java 9.

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.
Don’t hesitate to comment these informations if you think they could be useful for our current challenges.

Feedback from Devoxx France 2015

Architecture and Design

Web development

Build tools

Java

Cloud

DevOps

Sonar and continuous inspection

Build and Continuous Integration

Nexus

Test

Mobile development

Agile

SCM

IT Press Review – april 2015

Dear followers,

This press review focus on Development Accelerators (like JHipster or Ionic Framework) and AngularJS 2 (and the big choice of Google to use Microsoft TypeScript!).

You will find also the 2015 survey of StackOverflow on developer profiles and technologies.
Some contents refer to Devoxx France 2015 which took place last week (8-9-10 april) ! A special page will be published on that very soon!

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.

Development accelerators

Build tools

Java

DevOps

Sonar and continuous inspection

Jenkins and Continuous Integration

Nexus

Test

Web development

Mobile development

Agile

IT Press Review – march 2015

Hi,

you will find here my press review around Continuous Integration and IT development solutions.
As you know, Continuous Integration is not only a way to build automatically, but also a path to development industrialisation.
That’s why you will find here news on tools (like Gradle or Maven), architecture (like Spring) but also methods and processes (like DevOps).

I hope you will find here some interesting information on your current investigations. Most of them are in English, but some are in French.

 

Java development tools

DevOps

Sonar and continuous inspection

Jenkins

Nexus

Gradle

Test

Web development

Mobile

Agile

Security