Testing - Defect – Metrics

Defect – Metrics

Metrics:

Metrics are the measurements that measure the QUALITY of the Application / Software

There are several metrics available.

Below are most commonly used metrics in TESTING Platform.

Metric Name	Description
Stability Trend Chart	Total number of defects found during a Build or Cycle. Also this contains the build history
Defect/KLOC	Number of total defects found per Kilo Lines of Code (KLOC)
Defects per Test	The defects that are found per each of the test type Smoke / Functional / Integration / System / Regression
Defects per Module	Defect that are found against the Components and Modules
Severity Index	Weighted average of defects logged
Test Coverage	Test coverage of the product for a given release. The total number of test cases designed / executed / passed / failed

Read More...

Testing - Defect – Priority Levels

Defect – Priority Levels

Priority:

• Priority is the rate of attempting a bug
• Priority is the choice of picking a bug to be fixed
• Priority is the importance of the requirement that is missing / misbehaving  / in correctly working

Priority:

•  Priority is always DEV oriented
• DEV defines the Priority to a bug

Priority	Guidelines
Critical	Need to Fix within 24 hours Very Urgent fix needed
High	Resolve Immediately
Medium	Resolve Pre-Release
Low	Desired but not urgent

Read More...

Testing - Defect – Severity Levels

Defect – Severity Levels

Severity:

• Severity is the complexity of the bug
• Severity is the importance of the bug
• Severity is the importance of the requirement that is missing / misbehaving  / in correctly working

Severity:

• Severity is always QA oriented 
• QA defines the Severity to a bug

Severity	Guidelines
Critical	System Crash Missing major functionality Any defect that prevents execution of test cases
High	Erroneous functionality Loss or corrupted data transformation Unexpected functional behavior Wrong/missing features in functionality Major non-Conformance to GUI standards Work around exists but is complicated
Medium	Errors in the display of graphics and content Unexpected functional behavior which are not show stoppers Minor non-Conformance to GUI standards Defect in code, but simple workaround exists
Low	Cosmetic errors / Spelling mistakes Defect causes minimal or unnoticeable problems

Read More...

Testing - Defect - Defect Life Cycle

Defect Stage	Responsibility	Activities
Defect is entered	QA	The initial state is always NEW It is unassigned  (Assigned to Dev Manager) Email will be sent to the  Team
Triage Discussion	QA / DEV / PM	Prioritize defects brought into Triage meeting Determine which Release/Build the fix will be made in Assign defect to relevant team member.
Assignee	DEV	Due to automatic notification via email from the defect database, the assignee knows they have been assigned for a defect. Reproduce the defect, change status to OPEN Recognize the bug and change status to 'Duplicate' of another bug and specify what it is a duplicate of Reproduce bug, recognize problem, make fix, unit test, check in code and change status to 'Fixed'
Defect  Verification	QA	Evaluate fixed bugs – ensure that they are fine working Evaluate reproducible steps. Verify fixed bugs à move to Closed OR move back to Re-Open state, if the fix failed

Read More...

Testing - Defect - Defect Documenting

Issue Summary:

Admin – Login page does not show up any validation messages

URL:

http://server2/ScarGlobalLifeInsurance2/AdminLogin.aspx

Navigation:

Home Page – Admin – Login

Steps to reproduce the issue:

·        Navigate to SGIS – Home page using URL: http://server2/ScarGlobalLifeInsurance2/Default.aspx

·        Click on the Admin link from the footer menu

·        Observe that Admin login page loads up

·        Try hitting the LOGIN button without entering any user name and password data

·        Observe that there are no validation messages shown up

Observation:

·        Admin login page should indicate /show up validation messages when user inputs invalid data

·        Admin login page should indicate /show up validation messages when user clicks on Submit without entering any data on the login page

Snapshot:

NA

Read More...