We worked for a leading IT services provider of large scale global software projects to customers across the globe. They provide end-to-end IT services to Clothes, Retail, Footwear and Fashion industries.
Need
The Need was to dig effectively into the mobile application market; the client had developed an application to ensure best-in-class services to the end users. The application required an end-to-end performance testing solution to avoid the risk of losing traffic, revenues or employee productivity. They needed a reliable QA and testing service provider that is well equipped to assist their entry in a mobile dominated market with growing end user desires. They likewise needed the vendor to simulate a volume of 200 concurrent mobile users realistically, check that the servers are free from load related performance issues and ensure that the users get acceptable response times with 100% availability.
Solution
We designed and implemented a comprehensive mobile application performance testing plan for the client’s Product Lifecycle Management system to evaluate how the application would perform in the real world when subjected to accurate and realistic scenarios with variable network conditions, and on multiple devices.
We used NeoLoad for simulating user load to conduct effective load testing. Using real devices or emulators in this case was unfeasible as it demands acquiring, configuring, and synchronizing hundreds or thousands of real devices or machines running emulators.
Any hybrid mobile application requires a web service request-response from and to the server application. These web-service requests and responses were captured using Proxy mode and Tunnel mode available in the tool. Recording in these modes enabled performance testing of the application and the server using different Mobile Network Emulation like GPRS, EDGE, 2G, 3G or 4G LTE from the cloud and on premise with bandwidth constraints, latency and packet loss simulation.
Other tests executed under this engagement included, multiple cycles of smoke test, 200 concurrent user baseline test and WAN emulation test (Baseline load test for different WAN emulation like Edge,3G,3G+,4G& WIMAX).
We helped the client deliver the application after comprehensive testing on the scheduled delivery time and within budget. We also ensured customer satisfaction with proactive communication, international standard of delivery, 24/7 support, and effective documentation process.
SITUATION
The client developed a versatile application for best-in-class services to end users. This required a solid QA and testing solution to ensure their successful foray into the mobile application market.
IMPACT
The client was looking for an end-to-end performance testing solution to avoid the risk of losing traffic, revenues or employee productivity. The testing needed to simulate a volume of 200 concurrent mobile users realistically, check for load related performance issues and ensure that users get satisfactory response times with 100% availability.
RESOLUTION
We planned and executed a comprehensive mobile application performance testing plan to evaluate how the application would perform in the real world when subjected to accurate and practical situations with variable network conditions, and multiple devices.
Figure below represents the performance testing approach adapted
Recreate real-world server conditions
- Creation of the scripts specific to a workload type in terms of where the requests are generating from
- Creation of load testing scenario specific to the load and the associated scripts for a workload type
- Generation of load from the load generators in terms of number of users from different geographic locations
Recreate real-world server conditions
- This involves identifying and recreating the conditions on the network to be targeted, while gauging the application's performance on the target device
- Network type and quality (3G/2G/WiFi/Etc)
- Network load (bandwidth utilized)
- Network by geography
Recreate real-world server conditions
- This involves identifying and recreating the conditions on the mobile device to be targeted, while gauging the application's performance on the target device
- Application Type (Thin Client)
- Platform Type (iOS)
- Device Type (iPad)
Recreate real-world server conditions
- Server
- CPU usage
- Load
- Process time
- Bytes total
- User time
- Packets sent/received
- Network
- Packets and bytes sent
- Packets and bytes received
- Average delay
- Packet drops
- Device
- CPU and memory usage
- Method level profiling
- Web application component level performance
- Response times
- Transactions
- Response times
- Throughput
Benefits
- Cost savings of up to 70% due to pay per use model of licensing
- Our extensive experience in effective handling of outsourcing projects and providing independent testing services helped the client remain focused on sales and strategic planning
- On-time delivery and on-schedule reporting provided the client an edge in product’s market introduction and saved their time
- Our expertise in mobile test automation and testing capacity provided the client guaranteed quality assurance.
No comments:
Post a Comment