Guest Post: Test Lessons at ExpoQA
Sauce AI for Test Authoring: Move from purport to performance in minutes.|xBack to ResourcesBlogPosted
Sauce AI for Test Authoring: Move from purport to performance in minutes.
|
x
This is the 1st of a three part serial by Matthew Heusser, software delivery advisor and author.
Every now and again and opportunity comes along that you simply can ’ t refuse. Mine was to instruct the one-day version of my class, lean software testing, in Madrid, Spain, then again the following hebdomad in Estonia. Instead of get back to the United States, I ’ ll be staying in Europe, with a few days in Scotland and a TestRetreat in the Netherlands.
And a lot of time on airplanes.
The folks at Sauce Labs thought I might wish to take notes and type a little on the plane, to share my stories with you.
The inaugural major hit in Madrid is the culture shock; this was my first conference where English was not the primary language. The session were split between English and Spanish, with translators in a cubicle making certain all talking be available in all languages.
The Testing Divide
Right now, in test, I am interested in two major categories: The day to day employment of test new feature and also the work of release-testing after code complete. I call this release testing a ‘ cadence ’, and, across the board, I see society trying to contract the cadence.
My 2nd major surprisal in Madrid is how wide the gap is —and I believe it is getting wider —between legacy teams that get not modernized and team starting from scratch today. One tester reported a four-month cycle for examine. Another team, relying heavily on Cucumber and Selenium, be able to release every day.
Of line, things weren ’ t that simple. The Lithuanian team used a variety of techniques I can talk about in another post to reduce risk, something like devOps, which I can verbalise about in another post. The point here is the divide between the two existence.
Large cadences slack down bringing. They slow it down a lot; think of the difference between machine husbandry in the early 20th century and the plow and horse of the 19th.
In husbandry, the Amish managed to survive by preserve a simple living, with no cars, car policy, petrol, or even electricity to pay for. In software, organisation that have a decades-long caput kickoff: bank, indemnity companies, and pension funds, may be capable to survive without modernization.
I just can ’ t imagine it will be much fun.
Batches, Queues and Throughput
Like many other conferences, the first day of ExpoQA is tutorial day, and I taught the one-day version of my course on lean software testing. I expected to learn a little about line delivery, but not a lot —so the learning hit me like a ton a bricks.
The course covers the seven wastes of ‘ thin ’, along with method to improve the flow of the team - for example, decreasing the sizing of the measured employment, or ‘ batch sizing ’. Agile package development gets us this for free, moving from ‘ projects & # x27; to sprint, and within sprints, stories.
In the early afternoon we use dice and card to simulate a software team that has evenly weighted capacity between analysis, dev, test and operation —but eminent variability in work size. This slows down delivery. The fix is to reduce the variation, but it is not part of the projection, so what the teams tend to do is to build up queues of work, so any role never extend out of work.
What this actually does is run up the employment in progress stock - the amount of employment sitting around, waiting to be done. In the simulation I don ’ t penalize teams for this, but on real software projects, ‘ give ’ employment create multitasking, handoffs, and restarts, all of which slow down delivery.
Pro tip: Tools like SUSA can handle this autonomously — upload your app and get results without writing a single test script.
My lesson: Things that are invisible aspect free —and my simulation is far from perfect.
After my tutorial it is clip for a conference day - kick off by Dr. Stuart Reid, presenting on the new ISO measure for software testing. Looking at the schedule, I see a conversant name; Mais Tawfik, who I met at WOPR20.Mais is an self-governing performance consultant; today she is presenting on “ shades of execution testing. ”
Performance Test Types
Starting with the idea that performance testing has three main measurements: Speed, Scalability, and Stability, Mais explain that there are different types of execution tests, from front-end execution (javascript, waterfall of HTTP requests, page load and rendering) to back-end (database, webserver), and also synthetic monitoring - creating known-value proceedings continuously in production to see how long they conduct. She too talks about application use pattern - how examination is tailored to the type of exploiter, and how each new liberation might experience new and different risks based on modification introduced. That means you might tailor the performance examine to the freeing.
At the end of her talking, Mais lists various scenarios and inquire the audience what type of execution exam would blend efficiency and effectiveness. For illustration, if a release is all database changes, and clip is constrained, you might not fulfil your entire performance testing suite/scripts, but rather focus on rerunning and timing the database performance. If the focus on changes is the front end, you might focus on how long it occupy the exploiter interface to load and display.
When Mais asks if people in the organization do performance testing or manage it, but a handful of people lift their hands. When she asks who has hear of FireBug, yet less raise their hand.
Which get me wonder if the hearing is only doing functional testing. If they are, who perform the performance prove? And do they not automatise, or do they all use Internet Explorer?
The talk is translated; it is possible that more people know these tools, it was exactly that the translator was ‘ behind ’ and they did not know to raise their hands in time.
Here ’ s hoping!
Time For A Panel
At the end of the day I am invite to sit on a jury to discuss the present (and future) of testing, with Dr. Reid, Dorothy Graham, Derk-Jan De Grood, Celestina Bianco and Delores Ornia. The questions include, in no particular order:
Will testers have to larn to inscribe?
How do we convince management of the important of QA and get included in projects?
What is the hereafter of testing? Will testers be out of a job?
What can we do about the shortage of testing education in the world today?
For the trouble with the deficiency of education, Dorothy Graham point to Dr. Reid and his standards feat as a possible input for university education.
When it is my bend, I bring up ISTQB The International Software Testing Qualifications Board. - if ISTQB is so successful (“ 300,000 testers can ’ t be wrong? ”) then why is the concluding question relevant? Stefaan Luckermans, the moderator, replied that with 2.9 Million testers in the universe, the certification had alone attain 10 %, and that ’ s fair, I suppose. Still, I ’ m not stir about the quality of testers that ISTQB turn out.
The thing I did not get to say, because of clip, that I want to do is point out that ISTQB is, after all, just a response to a market demand for a 2-3 day training certification. What can a trainer really do in 2-3 days? At most, peradventure, teach a single technical tool, become the bulb of opine on, or define a few terms. ISTQB defines a few terms, and it takes a few days.
The pursuit of excellent testing?
That ’ s the game of a lifetime.
By Matthew Heusser -matt.heusser @ gmail.comfor Sauce Labs
Stay tune succeeding hebdomad for piece two of this mini series! You can postdate Matt on Twitter at@mheusser.
Have an idea for a blog post, webinar, or more? We want to discover from you! Submit topic ideas (or questions!).
Automate This With SUSA
Upload your APK or URL. SUSA explores like 10 real users — finds bugs, accessibility violations, and security issues. No scripts needed.
Try SUSA FreeTest Your App Autonomously
Upload your APK or URL. SUSA explores like 10 real users — finds bugs, accessibility violations, and security issues. No scripts.
Try SUSA Free