10
Jun

Top 25 HP LoadRunner Interview Questions and Answers

Top 25 HP LoadRunner Interview Questions and Answers


Q1. What is the difference between risk and failure?

Risk is potential problem that has not yet occurred but is likely to happen and that may cause the failure of the software product.
Failure for the end user is deviation of the component or system from its expected delivery or expected product.

Q2. What are different components of Load Runner tool?

Load runner has following components:

Vugen: Vugen is used to create the automated performance scripts.
Controller: It is used to organize, drive, manage and monitors the load tests.
Analysis: It helps us to view and compare the test results.
Load Generators (LG): It is the component which is responsible to generate and run the Vusers to put load on the system.

Q3. What is correlation and how do you find it?

Correlation is used to find out the data which is unique for every run such as session ids, or unique ids which change every time we perform the step. They can be found out by comparing the same scripts manually or automatically in Load runner

Q4. How many sections are there in load runner vugen?


There are basically 3 sections:

  • Vuser_init: At this section, the starting transactions such as login etc is defined.
  • Action: this lists all the actions performed.
  • Vuser_end: at this section, we define the logout or closing functions.

Q5. How many logging options are available in load runner and when do we use them?

    • Standard Log Option: When you select Standard log, it creates a standard log of functions and messages sent during script execution which can be used for debugging. Disable this option for large load testing scenarios. When you copy a script to a scenario, logging is automatically disabled.
    • Extended Log Option: Select extended log to create an extended log, including warnings and other messages. Disable this option for large load testing scenarios. When you copy a script to a scenario, logging is automatically disabled. We can specify which additional information should be added to the extended log using the extended log options.

Q6. What do you mean by scenario in load runner?


A scenario defines the events that occur during each testing session. For example, a scenario defines and controls the number of users to emulate, the actions to be performed, and the machines on which the virtual users run their emulations.

Q7. How you can capture the dynamic value in load runner, explain the function used?


We can capture the dynamic value by “web_reg_save_param” function. The syntax for the function is “web_reg_save_param (“ID1Value”, “LB= value=\””, “RB=\””, “Ord=1”, LAST);” if you specify ORD= ALL it will takes all the values and form an array

Q8. What does lr_abort function do in HP Load Runner?


It aborts the execution of script and end the execution if any error occurs. For this we need to uncheck continue on error in runtime settings.

Q9. Have you ever handled a “captcha”? What are the challenges you faced?


Captcha can’t be detected by load runner so in need to handle that we can ask the dev to disable the functionality or to make it static value. Another way is to send the captcha value in response so that we can correlate it.

Q10. What is the use of “lr_paramarr_random” function and where we use it?


This is used to pass random values in any code where the values are captured by ordinal all function.

Q11. What is the extension of scenario file in load runner?

It is saved as .lrs.

Q12. How many check points are available in LoadRunner?

We have mainly 2 check points:

  • Image Check
  • Text Check

Q13. How to create monitor in Load Runner?

  • On My Performance Center navigation bar, select Resources > Test Resources.
  • Click New Monitor Profile. The Create New Monitor Profile dialog box enables you to add a new monitor profile.
  • In the Monitor Profile page, click Add Monitor button. Select monitor in Add New Monitor page.
  • In the Edit Monitor dialog box, enter the required information and select the counters that you want to monitor. The Edit Monitor page varies depending on monitor type you select.

Q14. What is the difference between HTML and URL based recording in LoadRunner?


HTML level will generate a web_submit_form statement that only records options an end user is allowed to see and change.
URL level will generate a web_submit_data statement that records all data that was actually sent from the browser to the server.

Q15. What is 90% in Load Runner report?

If you arrange 100 response times from good to bad i.e. in ascending order. The 90 percentile response time is the 90th response time. So, if 90th response time is in the acceptable range, we can say 90 out of 100 response times are in the acceptable range. Other 10 might be in the acceptable range or may not.

Q16. If a page has 5 products and you have 5 virtual users, how will you perform click on one product??

We can parameterize 5 links with sequential iteration, So that each virtual user picks one link sequentially and executes it.

Q17. What is goal oriented scenario? What goals can be achieved through it?

Load Runner provides you with five different types of goals in a goal oriented scenario:

  • Number of Virtual Users
  • Hits per second
  • Transactions per second
  • Pages per minute
  • Transaction response time

Q18. Tell any default monitoring tool which comes with windows?


“Perfmon” is a default monitoring tool which is inbuilt in all windows system which can be called by typing “perfmon” in run.

Q19. Where do you set automatic correlation options?

Automatic correlation from web point of view can be set in recording options and in correlation tab. We can enable correlation for the entire script and choose either online messages or offline actions where we can define rules for that correlation.

Q20. Have you worked on user defined functions in LoadRunner? How can we create them?

Before we create the User Defined functions, we need to create the external library (DLL) with the function. We add this library to VuGen bin directory. Once the library is added, we assign user defined function as a parameter. The function should have the following format: __declspec (dllexport) char* (char*, char*)\.

Q21. How can you debug a Load Runner script?

VuGen contains two options to debug Vuser scripts:

  • Run Step by Step command.
  • Putting breakpoints in a script.

We can also manually set the message class within the script using the lr_set_debug_message function.

Q22. What changes can you make in run time settings of Load Runner?

There are four run-time settings that can be done:

  • Log: Logging can be set to standard or disabled.
  • Pacing: This contains iteration count.
 

Q23. Name different selection methods while selecting data from a file in Load Runner?

It can be done in 4 ways:

  • Sequential
  • Random
  • Unique
  • Parameter Name.

Q24. How can we find out database issues in our application?


Data resource graphs and monitors can be used to determine any such issue in database. In LoadRunner, we can specify the resource which needs to be measured before the controller runs.

Q25. What type of graphs available in Load Runner?


There are following types of graphs:

  • Network delay time graph
  • Transaction response time graphs
  • Hits/second graph
  • Pages download/second Graph.






9
Jun

Top 25 Performance Testing Interview Questions and Answers

Top 25 Performance Testing Interview Questions and Answers


Q1. What is Performance testing?

Performance testing is a discipline where we test our system to evaluate the system performance when subjected to virtual user load.

Q2. How is Load Testing different from Stress Testing?

Load Testing: It is the simplest form of testing which is done by increasing load step by step to reach the defined limit or goal.
Stress Testing: We can also call it as negative testing as we test the system beyond its capacity to find out the break point of the system.

Q3. What is concurrent user load in performance testing?

Concurrent user load can be defined as when multiple users hit to any functionality or transaction at the same time.

Q4. What is a protocol and how many you have worked on?

A protocol is a set of rules for information communication between 2 or more systems. There are many protocols such as Http/Https, FTP, Web Services, Citrix.Mostly used protocols are Http/Https and Web Services.

Q5. How can you check the system for memory leaks?

We can identify the memory leaks by running load tests for a longer durations and analyzing the ram of the system, generally it will grow with time and will lead to deadlocks and breakpoints.

Q6. Can you tell a scenario where throughput is increasing with response time means when they are directly proportional?

Yes it can be possible when you have lots of CSS (Cascading Style Sheet) in your application which takes a lot of time to display. We can expect this type of situation where throughput will be increasing as well as the response time.

Q7. What is Think Time?


Think time can be defined as the real time wait between 2 consecutive transactions. For Example a real time user waits to evaluate the data he received before performing the next step, that wait time he takes can be stated as think time.

Q8. How do you find out the performance bottlenecks?


Performance Bottlenecks can be identified by using different counters such as response time, throughput, hits/sec, network delay graph. We can analyze them and tell where the suspected performance bottleneck is.

Q9. How you can calculate pacing for your application?

We can calculate pacing by the formula as
No. of users = (Response Time in seconds + Pacing in seconds) * TPS
TPS is transaction per Second.

Q10. What is Ramp-Up and Ramp-Down?

The rate at which we increase the load on system by adding virtual users is called ramp up.
The rate at which virtual users exit from system is called as ramp down.

Q11. What is performance engineering, how its different form performance testing?

Performance testing is the process where we identify the issues in the system.
Performance engineering is the process where we address the issues and rectify them.

Q12. How do you do the analysis of the system for identifying issues?

We can study the various graphs generated by the tool such as Response time, throughput graph, running Vusers graph etc. and also we can see the server logs to identify the issues in system.

Q13. Have you worked on some analysis tools, if yes explain?

Yes, there are many tools available for analysis such as Dynatrace, Cawily. We can use these tools to see the exact transactions and queries running on the AUT to identify the root cause of any issue or failure.

Q14. What is IP spoofing and why is it used?

IP spoofing is used to spoof the system so that each host machine can use many different IPs to create hypothetical environment where system believes that request are coming from different locations.

Q15. List down any challenge you faced in your performance career and how did you overcome it?

Yes, I faced many challenges like defining the scope of application, break points which I over came by studying the historical data of application and based on them I decided the values, setting up the performance environment including proxy bypassing, connecting to Server under test.

Q16. What can be key factors in deciding whether we need a performance testing for any application before going live?

We can decide based on following factors:

  • How many are the target users?
  • How much application will grow with period of time?
  • Who all are competitors and how much traffic they general get?
  • How many critical scenarios we have?
  • How much will be the business loss if site is unavailable?

Q17 . Have you ever seen “No Data available for current settings”? When do we get this?

Yes, this comes when you do not have enough data in your data pool. So, we need to make sure that we have created the data pool as per the settings of conductor.

Q18. What is difference between Scalability testing and Load testing?

Load testing is done to see the application behaviour under defined load.
Scalability testing is done beyond the defined load to see how scalable your application is and find out the breakpoint.

Q19. What is difference between Simultaneous user and Concurrent user?

Simultaneous users wait for other user to complete then it starts its activity whereas in concurrent users, it can be like 2 users log into the system and perform different activities at the same time.

Q20. How to find bottlenecks and resolve them?

We first need to analyze all the counters like Memory Leaks, Avg. Time taken, Concurrent user load, throughput etc. Based on the analysis results, we will find out where bottleneck could occur. Then parameters need to be fine-tuned in DB2 Server like Queries, Stored Procedures, PL/SQL, Indexes, Locks, No of open connections etc.

Q21. What best practice you will follow if asked for setting up a performance bed?

  • We need to get the clear understanding of the architecture of system under test.
  • Have to setup the best possible replica of production aka stage.
  • Understand the usage growth of application as well as under different time zones
  • Identifying the critical flows of application.

Q22. What is performance tuning? How many types are there?

Performance tuning is done for improving the system performance:

  • Hardware Tuning: Optimizing, adding or replacing hardware components of the system and changes done in the infrastructure level to improve system performance is called hardware tuning.
  • Software Tuning: Identifying the software level bottlenecks by profiling the code, database etc. Fine tuning or modifying the software to fix the bottlenecks is called software tuning.

Q23. What are the key counters you monitor during a load test?

They can be transaction response time, memory usage, disk space, and CPU time.

Q24. What is the difference between Overlay graph and Correlate graph?

Overlay Graph: It overlay the content of two graphs that shares a common x-axis. Left Y-axis on the merged graph show the current graph value & Right Y-axis show the value of Y-axis of the graph that was merged.
Correlate Graph: Plot Y-axis of two graphs against each other. The active graph Y-axis becomes X-axis of merged graph. Y-axis of the graph that was merged becomes merged graph Y-axis.

Q25. What is the difference between hits/sec and req/sec?

  • Hits per second means the number of hits the server receives in one second from the vuser.
  • Request per second is the number of request vuser will receive from the server






19
May

Linux Inode

Linux Inode


What is Inode?

Inode is abbreviated as Index Node. As we know in Linux, whatever is there is a file. So, in order to maintain a consistency by treating everything as a file (even the hardware devices). The monitor, hard disk, printer, mouse, keyboard or directories are also treated as files in Linux. The regular files contain data such as text files, music files (mp3, mp4, audio etc.), video (multimedia files ) etc. Keeping aside the regular data, there is some other data about these files such as their size, ownership, permissions, time stamp etc. This meta data about a file is managed with a data structure known as Inode.

Where is Inode stored?

In Linux, file is stored in two different parts of a disk – the data blocks and the Inodes. The data block contains contents of a file. All other information about the file is stored in Inode.

Example1 : Rename a directory dir1 to Directory_1 which is in your current path

Syntax:

Kindly note that Inode number of dir1 will be same as Directory_1. In order to view properties of a directory, use ls –d  command.

Example2 : Prompt for confirmation before overwriting Examine.txt in /tmp directory

Syntax:

This is used while we are taking a backup so that updated file is stored and kept for use.

The input required during the prompted confirmation is:

  • For yes : YES, Y, yes, y
  • For no : NO, N, no, n

When the destination file permission is different than source file, mv –i  command will display the confirmation in following way:

Example3 :Move multiple files in specific directory. ( Let’s say  we have Linux_Lect1, Linux_lect2 and we need to move it to Linux_tuts directory). We have both Linux_lect1, Linux_lect2 in my current path:

Syntax:

Example4 : Take a backup of Destination file “Examine“ before overwriting a file:

Using a mv command  with – – suffix  option we can take a backup of destination file before overwriting .  The destination file will be moved with the specified extension:

–S

or

–suffix option.

Syntax:

Backup for Examine file is taken and changed to Examine.doc

Example5 : Suppose there are 10 files in directory d1 and we have copied any 8 files in directory d2. Now, we need to copy rest of the 2 files in directory d2.

Syntax:

-u option will perform update only if the source is newer than destination file






16
May

Linux ECHO Command

Linux ECHO Command


 

Usage of Linux ECHO Command:

This command is very important command widely used in bash and c shells. It is used to display a line of text/string on standard output or a console.

Syntax:

Example1 : Input a line “Hi, this is my session 2” and display on standard output.

pic1

Example2 : Declare a variable x and assign its value let’s say 30. Then, echo its value i.e. print value of x.

pic2

Example3 : Print statement “ I Love Linux” with no space using echo.

Explanation: Usage of \b as backslash interpreter.

pic4

Example4 : Print all words of a string keeping one word in each line. Lets take string as “I Love Linux”.

Explanation: \n is used as next line interpreter.

pic5

Example5 : Print all files and folder in current path using echo command (an alternative of ls command).

 


 






16
May

Linux CP Command

Linux CP Command


 

Usage of Linux cp Command:

This command is used to copy one or more files from source path to destination path.

Syntax:

Example1 : Make a copy of file into same directory.

Explanation:

  • Creates a copy of “originalfile” in present working directory. The copied file will be named as “newfile”.
  • Be very cautious while running the above command. If in case any file named as “newfile” exists in the same directory, it will be overwritten without confirmation prompt. This is the default behavior of cp command.
  • If you want to be prompted while overwriting a file, use interactive option (i). For example : # cp –i originalfile newfile. If “newfile “  exists , you will be prompted as:

    • cp : overwrite ‘newfile’?
  • If you type any of the combination (y,Y,yes,YES), the newfile will be overwritten and if you type any of the combination (n,N,no,NO), the newfile will not be overwritten, i.e. command will be nullified.

 

Example2 :Copy a file named as originalfile to another location say (/home/root). 

 

Or

Both syntax are same. The forward slash-dot (/.) is implied in second command (the dot is very special in every Linux directory which means  “this directory”).

Suppose originalfile is at following path: /home/root/folder1/contentfile. Then, above syntax will be written as:

Example3 : Copy a file named as originalfile to another location say (/home/root) with a new name testFile.

Example4 : Copy all files starting with word “testing” from home directory of user “root” to home directory of user “govind”.

Note : Asterisk (*) is a wildcard or special character which expands to match other characters.

Example5 : Copy all files from the home directory of root to home directory of user ram.

Example6 : See what cp command is doing.

Example7 : Create backup date of each copied file.

If destination folder already have a file and we know that by using cp command, it will overwrite the same in destination directory. So, we use – backup option , cp command will make a backup of each existing file.

–backup=simple option will create a backup file which will be marked by a tilde sign(~) at the end of file. —backup option has following control options:

  • none, off: no backup will be created (even if –backup is given)
  • number, t : make numbered backup
  • existing, nil : numbered if numbered backup exist, simple otherwise.
  • simple, never: always make simple backups.
Assignment

Few questions with their answers are present in assignment section for this command.


 





15
May

Linux LS Command

Linux LS Command


 

Usage of Linux LS Command:

This command is used to get list of files & folder at a particular path. Suppose there is a folder containing files and you want to know what all files are there in that folder we use this command. We use certain switches to get desired output.

Syntax:

Example1 : List all files in a folder.

pic1

Example2 : Show all the files of a directory, size, modified date and time, file and folder name and owner of file and its permission.

pic2

Example3 : View all hidden files in the folder.

pic3

Example4 : Know all files and directories in a current folder.

pic4

All files which are followed by / are directories and rest are files.

Example5 : List all files in reverse order.

pic5

Example6 : To print all files in reverse order.

pic6

Example7 : Sort the files by files size.

pic7

Example8 : List your home directory.

Example9 : List the home directory of user “Aman”.


 






14
May

Linux SU Command

Linux SU Command


 

Usage of Linux SU Command:

This command is used to become another user in his own session. By default, user without username will login as super-user (i.e. Root).

Syntax:

Example1 : Login as “guest “user.

Example2 : Run specific command with another user privilege say govind.

-c option is used to return back to the command line of former user after execution is completed.

Example3 : Login as root user.

Or

Note: In Linux while giving password it won’t be visible because of security reason.


 






10
May

Linux Introduction

Linux Introduction


 

Some historical fact for Linux:

In 1991, in Helsinki, Linus Torvalds began a project that later became the Linux kernel. He wrote the program specifically for the hardware as he wanted to use the functions of his new PC with an 80386 processor.

What is Linux?

Linux is an Operating System.

What is Operating System?

Low level software that supports a computer’s primitive function such as scheduling tasks and controlling peripherals.

Types of Operating System:

  1. System Software: System software are those software which incorporate the programs that are dedicated to manage the computer itself, such as the operating system, file management utilities, and disk operating system.For instance : Linux , Windows etc
  1. Application Software: Application software or simply applications, are often called productivity programs or end-user programs because they enable the user to complete. Specific examples of application software incorporate Microsoft Office, Excel and Outlook, Google Chrome, Mozilla Firefox and Skype.
  1. Utilized Software: Utilized Software or a business application is any software or set of computer programs used by business users to perform variety of business functions.  For instance: Antivirus, McAfee etc.

Finally we conclude: Linux is Open Source Operating System. Specifically Linux is System Software providing an interface between user and computer.

Advantages of Linux:

  • Linux is very durable.
  • Linux is less susceptible to computer malware.
  • Linux as compared to other OS is fast and does not slow down over time.
  • Old desktop/Laptops can be given new life using Linux OS
  • Linux has variety of distributors so we have many varieties in Linux.
  • Because there are many distributors you can freely access this software.
  • It’s a superior method of upgrading software

Disadvantages of Linux:

  • Many windows programs will not run in Linux thus requires a change.
  • There is a smaller selection of peripheral hardware drivers for Linux.
  • People who are new to Linux requires to learn this skill thoroughly in order to use the Operating System.

Features of Linux OS:

  • There are two prompts in Linux
    • $ -> Local user prompt
    • # -> Admin user prompt or Root Prompt
  • Commands are followed by switches but it does not matter in which order we are using switch.
    Example: ls –lrt is same as ls –rtl same as ls -l -r -t
  • Linux is case sensitive so using upper case will give different output and lower case different.
  • Linux is Open source operating system.
  • Several program are running at same time.
  • Several users on same machine at same time

Wild characters in Linux

S. No. Wild Characters Description
1 * Asterisk find any number of characters in a filename, including none.
2 ? Question mark find any single character.
3 [] Square brackets enclose a set of characters, any one of which may match single character at that position.
4 Hyphen used within [ ] denotes a range of characters
5 ~ Tilde at the beginning of a word expands to the name of home directory.

 






9
May

Linux Tutorial

 

Linux Tutorial


In this free Linux Tutorial, we will cover most important topics of Linux in a short, crisp and concise manner. Tutorial sections will have Linux Commands with examples and brief of each command how it works. This tutorial will cover Linux Beginner Level to Linux Advanced Level. In case, you are good in Linux and want to assess your knowledge. You should solve the Linux Assignments present and take the Linux Quiz to see where you stand. 

Pre-Requisites

To learn this tutorial, you don’t require any previous knowledge of this domain. Having knowledge in this domain is an added advantage.

Audience

Anyone who wants to gain extra knowledge of Linux Operating System and Linux Commands. This course can take up by students, geeks, Linux developers, testers, administrator. After completing this tutorial, you will find yourself ready to browse Linux Operating System, to answer Linux Interview Questions and to explore more around Linux.




 



20
Feb

Writing Effective Business Emails

In this post of Writing Effective Business Emails, we will be covering following:

Addressing:

  • Limit to who really needs to know.
  • Make it clear in text who has action and who is info addressee.
  • Use BCC to protect Email addresses unless everyone knows each other.
  • Watch Reply All.
  • Use address book & validate often.
    • Avoid typing addresses free hand; many addresses are similar; watch auto fill.
    • Send same message to multiple recipients by editing message as new or cutting and pasting.
  • Make sure forward does not embarrass sender.
    • Get permission if in doubt.
    • Never “disrespect” sender in forward or reply.
  • Fill in addresses last to avoid sending an incomplete Email by mistake.

Subject Line:

  • Headline (think newspaper).
  • Grab Attention.
  • Summarize message.
  • Make it easy for recipients to triage your Email and find it later.
  • Don’t “Reply All” to a message to grab addressees without changing subject.

Opening Lines:

  • With reference to your letter of 8 June, I …
  • I am writing to enquire about …
  • After having seen your advertisement in … , I would like …
  • After having received your address from … ,I …
  • Could you please help me with the following…..
  • This is to inform you that…..

Closing Lines:

  • If you require any further information, feel free to contact me.
  • Please let me know in case any other information is required.
  • I look forward to your reply.
  • I look forward to hearing from you.
  • I look forward to seeing you.
  • Please advise as necessary.

Message Text:

  • Keep the message focused and readable.
  • Keep it short.
  • Break into paragraphs; skip lines between.
  • Use short sentences.
  • Use plain text editor, not MS Word.
  • Avoid HTML.
  • Avoid fancy typefaces.
  • Write in standard professional English with Capitalization and correct spelling.
    • Don’t try to impress.
    • Avoid chat speak, e.g., gr8 & emoticons, J.
  • Don’t type in All Caps
  • Avoid !!!
    • Avoid using URGENT and IMPORTANT.
  • Use * * to highlight text if you need.
  • Proofread & Spell check.
  • Quote back selectively when replying to long messages.
    • “Yes, I agree.” is useless without context.
    • Top quote vs. bottom quote – no consensus.
    • Avoid “Fisking,” replying line by line in an argumentative manner.
  • For URL links, use Outlook inbuilt function to shorten long URLs or enclose in < >.
  • Identify yourself clearly to new contacts.
    • Hello, I am… The reason I am writing…
    • Hello, so-in-so suggested I contact you…
  • Respond Promptly.
    • Apologize if you aren’t able to reply promptly.
    • Interim reply when too busy.

Attachments:

  • Cut and paste relevant parts of attachment into text of Email.
  • Upload attachments to shared location / sharepoint and use URL links.
  • Recipients who do not know you, may be reluctant to open attachments or click URLs.
  • Ensure you insert attachment to avoid sending emails like “Oops, here’s the attachment.”
  • Post large attachments in a blog (if any) and then send an Email announcement.

Signature Line:

  • Include (For receivers information)
    • Your name
    • Title
    • Organization
    • Email address
    • Website / Blog
    • Phones
  • Can be shortened for frequent correspondents.

Confidentiality and Security:

  • Have a separate Email account for newsletters, announcements etc.
  • Delete browser history, cache, cookies, userids and passwords after using a public Internet connection.
  • Logout and close all Apps after using a public Internet connection. (Restart if possible.)
  • Don’t open company emails on non-secure personal computer.
  • Back up your Email.
  • Beware of spam.
  • Beware of Phishing attacks.
  • Never include personal or financial info in an Email.
  • Don’t unsubscribe from anything, you did not subscribe to.
  • Beware of friend’s Emails.

Using Outlook:

  • Organize Email into folders.
  • Keep a copy of all sent Emails.
  • Review and clean out folders periodically.
  • Don’t print Emails unless its important.
  • Use “out of office” status when away.

10 common Email habits that waste time and cause problems:

  • Vague or nonexistent subject line.
  • Changed the topic without changing the subject.
  • Including multiple subjects in one note.
  • Sending before thinking.
  • Inadvertent replying to all.
  • Omitting the context of a reply.
  • Misaddressed recipients.
  • Displaying addresses of recipients who are strangers to each other.
  • Replying vs. forwarding.

Points to Remember:

  • Write a meaningful subject line.
  • Keep the message focused.
  • Avoid attachments.
  • Identify yourself clearly.
  • Be kind — don’t flame.
  • Don’t assume privacy.
  • Distinguish between formal and informal situations.
  • Respond Promptly.
  • Show Respect and Restraint.

Latest Posts

17
Feb

Defect Life Cycle

Defect Life Cycle which is also called as Bug Life Cycle. Below is what we cover in this post:

Defect Life Cycle

Defect Life Cycle

Defect Status Explanation:

New:

When the bug is posted for the first time, its state will be “NEW”. This means that the bug is not yet approved.

Open:

After a tester has posted a bug, the lead of the tester approves that the bug is genuine and he changes the state as “OPEN”.

Assign:

Once the lead changes the state as “OPEN”, he assigns the bug to corresponding developer or developer team. The state of the bug now is changed to “ASSIGN”.

Test:

Once the developer fixes the bug, he has to assign the bug to the testing team for next round of testing. Before he releases the software with bug fixed, he changes the state of bug to “TEST”. It specifies that the bug has been fixed and is released to testing team.

Deferred:

The bug, changed to deferred state means the bug is expected to be fixed in next releases. The reasons for changing the bug to this state have many factors. Some of them are priority of the bug may be low, lack of time for the release or the bug may not have major effect on the software.

Rejected:

If the developer feels that the bug is not genuine, he rejects the bug. Then the state of the bug is changed to “REJECTED”.

Duplicate:

If the bug is repeated twice or the two bugs mention the same concept of the bug, then one bug status is changed to “DUPLICATE”.

Verified:

Once the bug is fixed and the status is changed to “TEST”, the tester tests the bug. If the bug is not present in the software, he approves that the bug is fixed and changes the status to “VERIFIED”.

Reopened:

If the bug still exists even after the bug is fixed by the developer, the tester changes the status to “REOPENED”. The bug traverses the life cycle once again.

Closed:

Once the bug is fixed, it is tested by the tester. If the tester feels that the bug no longer exists in the software, he changes the status of the bug to “CLOSED”. This state means that the bug is fixed, tested and approved.

Different Flows of Defect:

  • New — > Opened — > Fixed — >Closed
  • New — > Opened — > Rejected — >Closed
  • New — > Opened — > Fixed — >Re-opened — > Fixed –> Closed
  • New — > Opened — > Deferred
  • New — > Opened — > Rejected– >Re-opened — > Fixed –> Closed

Defect Life Cycle Implementation Guidelines:

  • Make sure the entire team understands what each defect status exactly means. Also, make sure the defect life cycle is documented.
  • Ensure that each individual clearly understands his/her responsibility as regards to each defect.
  • If a defect tracking tool (i.e. JIRA, Rational Clear Quest, Bugzilla etc ) is being used, avoid entertaining any ‘defect related requests’ without an appropriate change in the status of the defect in the tool. Do not let anybody take shortcuts, else you will never be able to get up-to-date defect metrics for analysis.

Latest Posts

 

15
Feb

Defect Priority & Severity

In this article, we will be covering following:

Defect Priority & Severity:

Priority:

—  Importance of the bug is known as Priority/Urgency to fix a fault.

Severity:

—  Impact of the bug is known as Severity /Impact of a failure caused by  this fault.

Defect Severity Levels:

Critical / Show Stopper

— An item that prevents further testing of the product or function under test can be classified as Critical bug. No workaround is possible for such bugs. Examples of this include a missing menu option or security permission required to access a function under test.

Major / High

— A defect that does not function as expected/designed or cause other functionality to fail to meet requirements can be classified as Major Bug. The workaround can be provided for such bugs. Examples of this include inaccurate calculations; the wrong field being updated, etc.

Average / Medium

— The defects which do not conform to standards and conventions can be classified as Medium Bugs. Easy workarounds exists to achieve functionality objectives. Examples include matching visual and text links which lead to different end points.

Minor / Low

— Cosmetic defects which does not affect the functionality of the system can be classified as Minor Bugs.

Defect Priority Levels:

Low

— The defect is an irritant which should be repaired, but repair can be deferred until after more serious defect have been fixed.

Medium

— The defect should be resolved in the normal course of development activities. It can wait until a new build or version is created.

High

— The defect must be resolved as soon as possible because the defect is affecting the application or the product severely. The system cannot be used until the  repair has been done.

Priority and Severity Examples:

High Priority & High Severity:

— An error which occurs on the basic functionality of the application and will not allow the user to use the system. (Eg. A site maintaining the student details, on saving record, if it doesn’t allow to save the record then this is high priority and high severity bug.)

High Priority & Low Severity: 

— The spelling mistakes that happens on the cover page or heading or title of an application.

High Severity & Low Priority: 

— If  there is an application that crashes after multiple use of any functionality (example–save Button use 200 times then that application will crash). Means High Severity because application crashed but Low Priority because no need to debug right now you can debug it after some days.

Latest Posts

13
Feb

Requirement Traceability Matrix – RTM

In this article, we will be covering following:

What is Requirement Traceability Matrix (RTM)?

  • RTM is a document that links requirements throughout the process of validation .
  • It is to ensure that all requirements defined for a software are tested.
  • It is a tool for the validation team to make sure that requirements are met during the validation of a software.
  • Matrix is created at the beginning of project on the basis of the project’s scope and deliverable’s.
  • It is bi-directional, as it tracks the requirement forward by examining the output of deliverable’s & backward by looking at the business requirement that was specified for a particular feature of the product.

Requirement Traceability Matrix – Parameters:

  • Requirement ID
  • Requirement Type (BRD and FSD)
  • Risk
  • Test Scenario ID
  • Test Case ID
  • Status
  • Defects ID

 

How to Create a Matrix?

Requirement Phase

QA Team start writing Test Scenarios & eventually Test Cases based on some input documents – Business Requirements Document (BRD), Functional Specification Document (FSD) and Technical Design Document (optional).

Ex:- BRD & FSD

BRD FSD
BRD

BRD

FSD

FSD

Design Phase

Based on the two input documents, below is the list of high-level scenarios to test:

TestScenarios_BRD

TestScenarios_BRD

For each Test Scenario, you are going to have at least 1 or more Test Cases. So, include another column and write the Test Case IDs as shows below:

BRD_TC

BRD_TC

At this stage, Traceability Matrix can be used to find gaps. For example, you see that there are no test cases written for FSD section 1.2 in the above Traceability Matrix.

As a general rule, any empty spaces in the Traceability Matrix are potential areas for investigation. So a gap like this can mean one of the two things:

  • The test team has somehow missed considering the “Existing user” functionality.
  • The “Existing user” functionality has been deferred to later or removed from the application’s functionality requirements.

If it is scenario 1, it will indicate the places where test team needs to work more to ensure 100% coverage. In scenario 2, TM not just show gaps it also points to incorrect documentation that needs immediate correction.

Execution Phase

Let us now expand the TM to include test case execution status and defects.

The below version of the Traceability Matrix is generally prepared during or after test execution:

BRD_Status

BRD_Status

 

Latest Posts

10
Feb

Difference Between Test Cases and Test Scenarios

This article isn’t only going to cover Test Cases Vs Test Scenarios but it will cover following:

Few years back, when I was working in an MNC and dealing with a testing project, I suggested my colleagues to document the test Scenarios instead of test cases. Can you imagine, their reaction amazed me as they all were staring at me all together, I could not argue. It was like I have made a big mistake in my life. Everyone’s opinion was same except mine. They prefer to follow the traditional method of writing Test Cases and not Test Scenarios. Those who are newbies in this field might get confuse with the word Test Scenarios and Test Cases. This article will clear all doubts about it by giving real time examples and explanation.

Few years later, I Switched to another company and handled a testing project which was based on searching and generating different reports with the help of different menu options. We in a team were discussing about the project and how we can proceed with that? Actually, client wanted that project early and we were having deadline to complete the project. Considering my last experience about suggesting the documentation of Test Scenarios, I kept quiet and thinking of other idea. Suddenly, one of my colleagues raised his voice that “We should prepare Test Scenarios in a document”. This time, everyone was quite satisfied with his idea and we further started preparing the Test Scenarios. The conclusion of both cases suggests that preparing the Test Scenarios and Test Cases depends on the urgency and requirement of the project. Generally, in companies, test cases are prepared rather than documenting test scenarios.

Test Cases are replaced with Test Scenarios

As we all know nothing is permanent and with this concept, the software industries and their processes are also changing with time and cost constrains.

V-models and waterfall models which are considered to be traditional models are being replaced by iterative and agile models. In every testing project, document is indeed essential but to complete the project fast within the deadline and to make the process transparent and easy, the way of documentation is changed these days.

Following conditions are applicable for documenting Test Cases:

  1. Client may ask for the same as part of his project
  2. No Time constrain(But, I don’t think, it’s possible)
  3. When software testers are fresher and new to the product.
  4. When there is Company policy (I strongly have faith that it can be altered)

One of my experience will give you clear picture.

I was handling one of the testing projects from fortune 500 company and they didn’t give us any deadline to complete the project. That mean we were having flexible timelines to complete the project. We were already having template of test cases, and with the help of that we prepared the test cases and it got approved from client as well.

Once the development team finished their module, they were giving us to test it and most of our duty was to follow 100 test cases in a day. We used to document with pass/fail result, further sending it to the client at the end of the day. The project was really big and had different modules within it. To do the same process of documenting the test cases was a monotonous work for some of my colleagues. But at the end of the day, the company was generating revenue from it.

During the project, we had one break where we were not having any task of documenting the test cases. We were having a good time and I was discussing about new ideas and techniques so as make improvement in the existing test cases. I have found during that discussion that none of my colleague was interested in implementing those new ideas and techniques as they thought all the test scenarios is been covered already while making huge amount of test cases. No one was really interested in putting the efforts for new techniques as it a human mentality that we do not want to rework once the work is done. Our mind automatically stops making any efforts for any new ways and techniques for the past work. Same had happened with my colleagues and they just wanted to relax on that certain day.

It is also a fact that in IT companies, most of the testers follow the mechanical process of making the test case and no one really makes effort to make additional test case for the existing one? The same might have also happened with you, if I am not wrong.

Another experience:

While extensively involved in a team challenge activity, we were having a discussion and asked the team members to prepare the test scenarios for the product. We have all started to make the test scenarios and there was not a specific document where we would literally fill expected result and pre-condition for each test case. At the end of the day, we have collected almost 50 test scenarios and it was indeed a great experience while proceeding with that project.

Below example will make picture more clear:

Assume that you are having your website and it has features like username, password, and login page along with cancel button. If you were asked to write the test cases for the above features then your test case may exceed 50 and if you would ask to write the test scenarios, then it will be just a matter of lines. Below explanation will give you the exact idea about test scenario.

High Level Scenario:   Login Functionality
Low Level Scenarios:

  1. To check Application is Launching
    2. To check contents text on login page
    3. To check Username field
    4. To check Password field
    5. To check cancel button and Login Button functionality

As we all are at short of time, test scenarios just acts as pain killer spray rather than that old time IODEX. And still the effect is same in both the case.

Finally, I would like to summarize difference as below:

 

Test Cases

Test Scenarios

What it is => A concept which offers complete info what to test, steps to be taken and expected result of the same A concept which offers one-line info about what to test.
It’s about => It’s more about documenting particulars. It’s more about rational and conversing particulars.
Importance => It’s significant when testing is off shored and development is onsite. Writing test cases with particulars will aid both dev and QA team in sync. It’s significant when time is less and most of the team members can agree / appreciate the details from one-liner scenario.
Advantage => One time documentation of all the test cases is helpful to track 1000s rounds of regression testing in future.
Most of the time, it is helpful while bug reporting. Tester just need to give reference of test case ID and does not require mentioning each and every minute detail.
A time saver and idea generation activity, favoured by new generation software testing community.
Modification and addition is simple and not specific to a person.
For a huge project, where group of people know specific modules only, this activity gives a chance to everybody to look into other modules and brain storm and deliberate.
Beneficial to => A full-proof test case document is a life line for new tester. Good test coverage can be attained by dividing application in test scenarios and it decreases repeatability and complexity of product
Disadvantage => Time and money consuming as it requires more resources to detail out everything about what to test and how to test If created by exact person, the reviewer or the other user might not sync the precise idea behind it. Need more discussions and team efforts.


Conclusion of this Post:

Test cases are most significant part of Software Testing Life Cycle which is also referred as STLC. With its absence, it’s tough to understand, track, follow and reason out something. But in the era of Agile, test cases are being substituted fast with test scenarios.

Database testing, GUI testing, functionality testing has the common test checklist which is coupled with modern artillery and test scenarios. With participation in trainings, Discussions, questions and practice one can definitely learn and change the final graph of Bug report matrix and your productivity.

Latest Posts

8
Feb

Tips for Salary Negotiation

Salary Negotiation is itself an art and this article will help you to engage few important points to consider while negotiating salary.

You need to be very smart while negotiating your salary. It is easier to say yes for the job, but when it comes to negotiating your salary then all the scenario changes suddenly. That’s why it is indeed essential that you know the tactics of it hence gaining satisfaction for the work that you will accomplish.

You need to impress your hiring manager by showing him your value gracefully. This might impress him while changing his mind to raise your salary. There are chances that your hiring manager may not change his mind at all, but that is absolutely fine as it is always good to raise your voice, hence adding value to personality. It will also show that you are taking this position seriously. If company goes through the whole recruiting-interviewing-hiring process again, chances are more that they spend huge cost, compared to previous scenario in the long run.

Salary Negotiation Tactics

Let’s take a simple example to make you understand more about Salary Negotiation and the tactics involved in it. Assume that you are selling your old car and the buyer asks you “What is the best price you have kept on this car?” You answer him by saying $9000 and the buyer quickly says agreed, sold it. Huh! This is the point when you start doubting yourself and feel that you might have offered very less value to the car. You might think that you would have increased the price with more dollars. Moreover, if the buyer asks you, “Don’t you think the price is too high, for this car?” then you firmly answer him “I have done my homework perfectly and this is the best price the car deserves”. At the end of the talk, the buyer finally agrees and pays for the asked price. This also gives you winning the conversation feeling, further gaining worth for sticking to your guns. Well, getting the big difference here?

The same happens while negotiating your salary in front of hiring manager. If you came to know that the company needs resource in their current project and they are looking for you as their potential employee, then it’s time for you to keep your worth. Have a discussion with your hiring manager at proper situation and tell him that you are beyond your midpoint level and need a boost in your salary so as it will keep you motivated. Tell him you are getting less salary then your peers, in spite of being such an incredible resource. Keep in mind that you need to be very polite and say this in very joking manner so that the hiring manager notices your perspective while not taking any negative out of it.

One tester from our Testing Community have applied same tactics in his current company and got a bonus of $5000 in base salary that finally benefitted him in the long run.

Have Courage

Having courage doesn’t mean you have to directly ask your employer about salary at first instance. Have patience first and see that you clear the pre-screening process and first round of interview. After that when you are being called for the second or final round of interview that time pay attention to the intention of the employer and what he is trying to convey you. Based on his question, answer smartly while keeping value of yourself. Believe in yourself and ask what you deserve. Do not hesitate for asking the value which you deserve the most. Have some courage while asking and negotiating the same.

Following questions and answers will help you in this.

Employer: Mr. John, what salary are you looking for?”

Candidate: Well, I am here for two reasons. Firstly, this company is excellent and always beyond in every aspect. Working here will definitely enhance my skills and confidence. Secondly, I will have a secure job. I have researched for this position and as per my knowledge, the salary offered for this role is around $65000-$70000. I would love to have salary in such range.

Employer:” We are impressed with your credentials and what salary would you expect for this position?”

Candidate: I am flattered to hear this and would like to work with this company. We will definitely work together and give our best. Currently, I am earning $65000 and primarily looking for at least $70000 as a base salary.

Tips for Negotiating Salary:

  • Don’t ask for salary unless employer asks you
  • Ask for benefits packages when answering for salary
  • Research well before applying for position
  • Don’t discuss salary over telephone
  • Keep in mind what salary you are worth for
  • Never underestimate your worth
  • Have patience and self-confidence

 

Latest Posts

6
Feb

How to Report or Log Bugs?

Following sample bug/defect report will give you precise clue of how to log bugs in a bug tracking tool. You can use any bug tracking tool for tracking the bug for your reference.

Below is the sample scenario which caused the bug:

Let’s say you have built a new application. Now, you want to create a new user with new information in the application. To achieve this, you should login and then navigate to USERS menu>New User and under that fill all the required details such as First Name, Last Name, Address, Age, Phone etc. After entering all the details you should save that info by clicking SAVE button. After this, you will get the message “New User has been created successfully”. This is the exact process that you should follow for creating new user in your website.

Log in and then navigating to USERS menu > New User you save all the info by clicking the SAVE button and BANG! You get an error message and system suddenly crashes down. At that moment, you should save that error message by capturing it and saving it into Microsoft paint file or wherever you feel comfortable.

This is actually a Bug scenario for a tester and he now needs to log that BUG into bug tracking tool. Different tools are used for tracking the BUG and some of them are JIRA, Bugzilla, IBM Rational Clear Quest etc.

How the bug is reported effectively in bug tracking tool?

Below is the sample bug report for above stated example :
(Note : ‘bug report’ fields vary depending on Bug Tracking Tool)

SAMPLE BUG REPORT:

Bug Name: Application crashed while clicking the SAVE button for creating a new user.
Bug ID: (It will be automatically created by the BUG Tracking tool once you save this bug)
Area Path: USERS menu > New Users
Build Number: Version Number 3.0.4
Severity: HIGH (High/Medium/Low) or 1
Priority: HIGH (High/Medium/Low) or 1
Assigned to: Developer-X
Reported By: Your Name
Reported On: Date
Reason: Defect
Status: New/Open/Active (Depends on the Tool you are using)
Environment: Windows 10/SQL Server 2008

Description :
Application crashed on clicking SAVE button for creating a new user, henceforth not able to create a new user in the application.

Steps To Reproduce:
1) Logon into the application
2) Navigate to the Users Menu > New User
3) Filled all the user information fields
4) Clicked on ‘Save’ button
5) Seen an error page “OWX847 Exception: Insert values Error…”
6) See the attached logs for more information (Attach more logs related to bug.. IF any)
7) And also see the attached screenshot of the error page.

Expected result: On clicking SAVE button, it should give a success message “New User has been created successfully”.

(Attach ‘application crash’ screen shot. IF any)

Save the defect/bug in the BUG TRACKING TOOL which you are using.  There, you will get a bug id that can be used further as a Bug reference.

Default ‘New bug’ mail will go to particular developer and the default module owner (Team leader or manager) for further action.

Latest Posts

 

2
Feb

Why to Learn Automation Testing?

This article is all about opting Automation Testing. But every tester who hasn’t yet learnt automation testing or never faced any need of automation might have a question that Why to Learn Automation Testing?. So, here we go:

In today’s rapid and changing day to day life, technology is going so far and challenging human mind to take risks so as to improve the quality and efficiency of software systems development. Considering the time and cost constraints, testing is neglected most of the time in an IT industry. This eventually affects the quality of the product which is further followed by customer disappointment and dissatisfaction. This also affects the overall quality costs of the project. For this reason, it is extremely important that testing should be carried out so as to improve the quality of the project along with customer satisfaction.

Below are few reasons which affects testing quality:

  • Poor testing strategy
  • Delay in Testing
  • Less efforts for creating test cases
  • Subsequent test maintenance

We can do testing of the application manually or by automation. If you are preferring manual testing then you have to do the monotonous work of writing test cases daily and maintain it as per the changing requirements. It is really a tedious work and requires lot of efforts to sit in front of computer continuously while getting bored at the same process. If the project is big and requires more test cases then manual tester’s life is hell as he fails at maintaining proper test cases. Here comes the role of Automation testing where you can actually automate your testing process hence increasing the efficiency of the complete testing process.

With Test Automation, you can improve the testing process of any software application. Initially, you may need to pay attention to the automation process but later you can thoroughly enjoy its results. Main benefit of automation testing is you can execute your test cases during night so that till morning you are done with the testing process.

Optimization of speed, efficiency, and quality along with decrease of costs:

Automated tests re-use modules within different tests and aids in fast running of the tests with great performance. If requirements are frequently changing in the project then you need to do the testing again and again to ensure the quality of the software product. Automation testing plays key role in this and provides great results on automation of regression tests. This saves time and benefits the company while quickly out-gaining the initial costs. This is the main reason that automation testing has overcome manual testing over past few years.

Increase of Test Coverage:

Another benefit with automation testing is that it increases the test coverage in wide scale. Manually covering the test case is very laborious and time consuming. With automation tests, you can achieve sufficient test coverage of your software projects.

Some examples of it include:

  • On different platforms, software testing with different configurations.
  • Data-Driven Testing (where there is a creation of tests using the same test steps but with different inputs)

With Test automation, you can actually perform different kinds of testing effectively and efficiently.

If you want long maintenance of your software products then you should automate your tests as it is very fast and frequent. It also decreases cost while enhancing quality of your software product. Most of the companies now work in agile environment where requirements change frequently and automation testing is better option to react with these ever changing requirements. The best part is new test cases are continuously generated which can be further added to existing automation in parallel to the development of the software.

Your test cases need to be extended for longer periods of time whether in manual or automation testing environments. This is indeed essential because software project continuously progresses and maintaining test cases is extremely important. You can achieve complete coverage of your test cases with automation as it is very reliable and realistic. Value of the test case vs the effort to create them should be considered while deciding which tests to automate first. Test cases which have low effort and high value should be considered first for automating. Moreover, frequently used test cases, regression test cases; along with test cases having low to moderate effort in setting up the development and test environment of the automation project are best matched for automation.

Latest Posts

1
Feb

Project Estimation Rules

Below Project Estimation Rules should be recalled when doing Estimation of a Testing Project: 

 

1st Rule: Software requirements are considered for Estimation

Software requirements are indeed essential for test estimation as it is based completely on what would be tested. The development team has much involvement in the software requirements as compared to the testing team and the requirements are mostly established by the development team. When all the estimation are done related to the project cost, duration of the project then the development team asks the testing team that how much time will be required by them in order to complete the testing of the application. The answer given by the testing team is considered for the SDLC process.

Testing team plays a vital role in estimation of the project because testing is an essential part of SDLC. Testing application, one can deliver a bug free application to the client.

2nd Rule: Expert judgment matters for the Estimation of the Project

The testing team classifies the requirements before estimating them in the following categories:

  • Critical: The development team has slight knowledge in how to implement it;
  • High: The development team has worthy knowledge in how to implement it but the task is not easy at all;
  • Normal: The development team has decent knowledge in how to implement. 

The expert opinion in each requirement suggests how long it would take for testing them.  The categories would eventually help the experts in estimating the effort for testing the requirements.

3rd Rule: Previous projects matter most for Estimation of project

Previous project knowledge and experience are used for the estimation of the project. If new project is introduced then its estimation is based on similar projects which have been executed previously. 

4th Rule: Metrics Helps in Estimation

Organization should create an Organization Process Database which is also referred as OPD, where the project metrics are recorded and referred for future projects.

5th Rule: The past should never be ignored while doing Estimation

Spreadsheets and Old process is still used by the testing team in order to estimate the project completely. If new rules are introduced during the process then the testing team follows that and at the same time compares the old process too so as to get complete idea in test Estimation.

The results which come from the new estimate process should be faster and cheaper as compared to the old process and in percentage of 20 to 20%. If different percentage are measured by the testing team then they go back to the old process to check whether they are missing something during the process or not.

 6th Rule: Recording of Estimation is indeed essential

During testing of the process all the results should be recorded in order to refer it for future projects. It is also beneficial when requirements of the projects change and hence the recording will eventually help the testing members in estimating the project. This will help testing team to not return all the steps again and will further help in taking same decisions. It also gives the opportunity to test the estimation before making any changes to it. 

7th Rule: Tools should be used while doing Estimation

A spreadsheet containing metrics eventually helps reaching the estimation as quickly as possible. The spreadsheet will calculate it automatically hence giving ease to the team members. It also helps in tracking the duration and time of the projects. 

Risk Table, and free notes should be included in the template and need to be filled in the tool. These tools also help in showing different options for testing which actually aids the customer in deciding which types of test he needs practically.

8th Rule: Estimation should continuously be verified

All estimation should be verified in a certain period of time.  Along with this, another spreadsheet for recording the estimations should be created.  The estimation is compared to the previous ones recorded in a spreadsheet so as to see if they have similar trend.  If the estimation has any deviance from the recorded ones, then it is indeed essential to a re-estimation of the entire project.

9th Rule: Risk factors should be covered in Estimation

Product down time, resource unavailability, skill improvement and learning capability are some of the risks that should be covered in test estimation.

Scenario for an Estimation:

Assume you have a project and you have estimated that it will take a 10 person team 300 days to complete. (3000 workdays – Sunny day scenario)

Knowing that there are 365 working days in a year (52 weeks x 5 days), without holidays, means that the project, at best, will take 1.13 years or 13.6 months to complete.

Suppose the average year includes 12 days company holidays (total impact = 12×10 people = 120 daysx1.13years = 136 days) and average employee takes 4 sick days and 3 comp days off a year (total impact = 7 x 10 people = 70 x 1.13 = 79)

Average employee takes 7 work days of vacation a year (total impact = 7 x 10 people = 70 x 1.13 = 79)

Suppose also that each employee drops 3 days out of each year for training (30 days)

Total duration change due to employee holidays, sick time, vacation and training = 136+79+79+30=324

Total workdays for the project is now 3000+324 = 3324 or a 10.8% increase in duration (300 day schedule is now 333 days or 15.1 months.)

Latest Posts

31
Jan

Project Estimation Techniques

If you want to be successful in Project Test Estimation then you should have execution knowledge which is eventually very significant in Software Testing Life Cycle. Software Test Estimation Techniques are indeed essential to make good reputation with your client when you bid for testing projects. It also gives you idea that how your approach should be during the execution of the project.

In case, you have experience in various software testing life cycle then chances are higher that you estimate your project very well as your experience may help you in providing various ideas & techniques for that testing project. It is practically not possible to put some number of days or estimate with old time formula of one third of the development effort. The requirement keeps on changing from client side & we have to adjust the same accordingly. Some companies which offer testing services use this formula which isn’t correct as it is not based on any scientific techniques or principles.

Following factors are indeed essential for any software test estimation and they are highly recommended in any software testing organization.

  • Team Knowledge on the subject/skills
  • Historical data for the previous estimation for improvement and accuracy
  • Domain Knowledge and core requirements
  • Risks and complexity of the application
  • Team Knowledge on the subject/skills
  • Bug cycles for the project
  • Estimation should include buffer time
  • Resources availability (Like vacations, holidays, and sick days can have a great impact on your estimates)
  • Bug cycles for the project

Many techniques are used in recent years that have been developed for test estimation of the software.

Some of the Estimation Techniques are:

 Following are the popular Test Estimation Techniques:-

Use – Case Point Method:

Use-Case Point Method is completely based on the use cases that we calculate the un-adjusted actor weights to determine the software test estimation.

Use case is a document which well specifies systems, different users or other stakeholders that interact with the concerned application. They are certainly named as ‘Actors’. The interactions achieve some defined goals hence protecting the interest of all stakeholders via flow termed or different behavior as scenarios. 

The formula used for this technique is:

  • Unadjusted actor weights = total no. of actors (positive, negative and exceptional)
  • Unadjusted use case weight = total no. of use cases.
  • Unadjusted use case point = Unadjusted actor weights + Unadjusted use case weight
  • Determine the technical/environmental factor (TEF) ( if not available take as 0.50)
  • Adjusted use case point = Unadjusted use case point * [0.65+ (0.01 * TEF]
  • Total Effort = Adjusted use case point * 2

3-Point Software Testing Estimation Technique:

3-Point Software Testing Estimation Technique is completely based on statistical methods where each testing task is broken down into sub tasks and further into three types on each tasks.

The formula used by this technique is:

Test Estimate = P + (4*N) + E / 6

Whereas P = Positive Scenarios or Optimistic Estimate (Best case scenario in which nothing goes wrong and all conditions are optimal.)

N = Negative Scenarios or Most Likely Estimate (most likely duration and there may be some problem but most of the things will go right.)

E = Exceptional Scenarios or Pessimistic Estimate (worst case scenario which everything goes wrong.)

Standard deviation for the technique is calculated as,

Standard Deviation (SD) = (N – E)/6

Work Breakdown Structure:

This method is created by breaking down the test project into small pieces. Modules are separated into sub-modules. Sub modules are then further separated into functionalities and functionalities are then separated in sub-functionalities.

You should review all the requirements from Requirement Document so as to make sure that they are added in WBS. Later, figure out the number of tasks your team needs to complete. Estimate properly the duration of each task.

Wideband Delphi Estimation Technique:

Following the same procedure as above in WBS. In this, work breakdown structure is disintegrated for each task and further distributed to a team comprising of say 3-7 members so as to re-estimate the task. The final estimate is the consequence of the brief estimates that are based on the team consensus. This method actually speaks more on experience instead of any statistical formula. Moreover, this method is initially popularized by Barry Boehm to emphasize on the group iteration so as to reach to a consensus where the team visualize on the different aspects of problems whereas estimating the test effort.

Function Point/Testing Point Analysis:

The Function Point technique is a direct pointer of the functionality of software application from the user’s viewpoint. This technique is the most accepted technique that is used to estimate the size of a software project. 

This technique is also a part of TMap. In function point technique, function points are converted into test points. In Test Point analysis, we carry out following:

  • Static Test Points
  • Dynamic Test Points
  • Environmental Factor
  • Control Factor
  • Productivity Factor
  • Primary Test Hours
  • Total Test Hours
  • Control Factors

In Software Testing, estimation is generally based on previously created application prototype or requirement specification document. To calculate FP for a project, some of the major components are required.  

The major components required are:

Unadjusted Data Function Points:

  1. Internal Files
  2. External Interfaces 

Unadjusted Transaction Function Points:

  1. User Inputs
  2. User Outputs & User Inquiries

Capers Jones basic formula: 

Number of Test cases = [Number of Function Points] x 1.2

Total Actual Effort, TAE = (Number of Test cases) * (Percentage of development effort /100) 

This method is used when requirement document or a detailed low level design document is available. Previous data for development and testing & measure of function point is available.

Latest Posts

25
Jan

Automation Testing: Process, Planning, Tool Selection – 2

Automation Tools:

Following are the most standard test automation tool used in most of the companies:

QTP/UFT: HP Functional Test, earlier known as HP’s Quick Test Professional is the Automation testing tool that supports number of environments such as Java, SAP, Delphi and many more. QTP can be collaborated with Quality centre which is actually a Test Management tool used for client/server applications.

Rational Robot: It is basically an IBM tool that is used to automate functional, regression and configuration tests for e-commerce, client server as well as ERP applications. This tool can be used with Rational Test Manager that helps in Test Management Activities

Selenium: This is an open source web Automation Tool which supports all kinds of web browsers and the most demanding tool in today’s market. Many companies are using this tool for sake of its performance and price. It can be integrated with multiple Test Management tools, Continuous Integration Tools etc.

How an Automation Tool should be chosen? 

It is really a tricky task to choose an Automation tool. Following criteria will assist you in choosing the best automation tool for your test automation.

  • There should be an Environment Support.
  • It’s easy to use.
  • Database Testing Feature should be present.
  • Object identification should be there.
  • Image Testing.
  • Error Recovery Testing.
  • Object Mapping availability.
  • Scripting Language should be used.
  • It should support various kinds of test such as- functional, mobile, etc
  • Multiple testing frameworks should be supported.
  • Debugging of automation software scripts is easy.
  • Should recognize objects in any environment.
  • Widespread test reports and results.
  • Lessen training cost of selected tools.

Automation Tool selection is one of major trials to be undertaken prior opting for automation. Initially requirements should be identified, various tools and its capabilities should be explored. You should set the expectation from the tool further going for a Proof of concept.

Framework in Automation 

A framework is actually a set of automation guidelines. It increases code re-usability, portability, reduce script maintenance cost etc. These are not rules and are not mandatory. You can script without following the guidelines. But you may miss some advantages of having a Framework. Guidelines are like:

  • Maintains consistency of Testing
  • Improved test structuring
  • Usage of code is minimum
  • Less Maintenance of code
  • Re-usability is Improved
  • Non-Technical testers can collaborate in code
  • Training period of using the tool can be lessen
  • Involves Data wherever suitable

Four types of framework are generally used in software automation testing:

  1. Hybrid Automation Framework
  2. Data Driven Automation Framework
  3. Modular Automation Framework
  4. Keyword Driven Automation Framework

What are Automation Best Practices? 

Observe the following to get maximum ROI of automation

  • Scope of Automation needs to be firm in much detail prior to start of the project. This will set expectations from Automation right.
  • Select the right automation tool: A tool should not be selected grounded on its status instead, it’s acceptance to the automation requirements.
  • Select suitable framework
  • Scripting Standards– Standards have to be followed during writing the scripts for Automation. Some of them include-
    • Generate constant scripts, comments and indentation of the code
    • Adequate Exception handling include – How bug is handled on system failure or unexpected behaviour of the application.
    • User defined messages should be standardized or coded for Error Logging for testers to recognize.
  • Measure metrics– Success of automation is determined by capturing the following metrics and not by comparing the manual effort with the automation effort.
    • Time requisite for automation testing for each and every release cycle
    • Percent of defects to be found
    • Customer satisfaction Index
    • Minimum Time taken for release
    • Productivity improvement

The above guidelines are indeed helpful while making selection of your automation tool.

What are the benefits of Automated Testing?

Following are advantages of automated testing:

  • Much more faster than the manual testing say 70%
  • Broader test coverage of application features
  • Consistent in results
  • Confirm Consistency
  • Saves Cost and Time
  • Increases accuracy
  • Human Intervention is not needed during execution
  • Rises Efficiency
  • Excellent speed in executing tests
  • Test scripts can be re-used
  • Test thoroughly and Frequently
  • Through automation, More  cycle of execution can be achieved
  • Primary time to market

Conclusion:

You should have three essential things for Automation to be successful. They are Right selection of automation tool, testing process and team. For successful testing, Manual and automation methods go hand-in hand.