Storage and storage network performance is critical to any industry which spends a significant budget on data storage. Public utility companies must keep up with bandwidth-demanding applications, and a user community that increasingly expects better service, in the face of intense scrutiny of costs and business margins.
To keep pace, storage architects within the public utility industry must wring the best performance out of existing platforms, and make well informed decisions on new storage deployments. Storage performance testing and validation is becoming a key component to cost-effective and responsive storage system rollouts. The primary goals are to reduce the risk of organizational interruption in the form of outages and performance issues, and to ensure the right product and amount of product is acquired. More specifically, the evaluation of storage infrastructure should include modeling the production application workload environment as accurately as possible. It should also enable the ability to pre-determine the performance limits of the storage system so that the next storage upgrade can be a carefully planned event instead of a disruptive fire drill.
“We were quite pleased with the process and results of the storage array tests. Load DynamiX worked closely with us and the vendors to show their products fairly and independently.”
— Infrastructure Manager,
Public Utility Company
This public utility company manages the flow of electric power to over 10 million customers. As the independent system operator, it schedules power on an electric grid that connects more than 20,000 miles of transmission lines and 200 generation units. It is subject to oversight by a Public Utility Commission and the state legislature. With the growth of data and the aging of its existing infrastructure, the company was investigating the addition of a large fibre channel storage system. After shortlisting three leading vendors, whose products all met the functional criteria including capacity upgrades over the life of the arrays, the decision came down to one of price/performance. The vendors all offered Proof of Concept systems, and the company began looking for a valid capability that simulates storage workloads representative of their production application workloads. Without the luxury of an in-house staff of architects, the decision was made to outsource the performance evaluation project.
After an online demonstration of the Load DynamiX capabilities and a conversation with an existing customer, the company decided to go with a Load DynamiX professional services engagement. A suite of test projects was co-created that (1) benchmarked performance under representative workload parameters, and (2) provided “what if” analysis that showed performance under 2X, 3X and 4X loads.
The customer worked with the Load DynamiX Professional Services team to define the performance tests, deploy the Load DynamiX appliance, run the tests, and analyze the results to empower the customer to make intelligent deployment decisions. The comparison was done by measuring performance characteristics (IOPs, throughput and latency) corresponding to the workloads generated by the Load DynamiX appliance.
The company then provided historical I/O performance data collected over two months. Data included one minute averages of Reads and Writes per second, Read and Writes MBs/second and Read and Write hit percentages.
Tests were then set up as in figure 1 below, so that each of the four FC ports on the Load DynamiX appliance accesses LUs on the arrays, also called Systems under Test (SUT), through different paths. The configuration of the paths was specific to every vendor. Each SUT had 30 TB of capacity provisioned for testing: six LUNs, 4 TB each and 24 LUNs 256 GB each. Each of the first three ports on the appliance targeted two LUs, 4 TB each. The last port (Port3) targeted the smaller LUN.
Additional details of the customer test environment included:
The Throughput over Time chart shows the performance difference between the 3 arrays in the most dramatic way (see figure 2 below):
“With Load DynamiX, architects can identify performance limits for their unique workloads and determine the strengths and weaknesses of any networked storage array.”
— Howard Marks, Chief Scientist
Another view is the custom workload 12-hour test. In the example below, at double the load performance, systems 2 and 3 are almost identical (system 2 graph is hidden behind system 3). System 1 is not achieving the same level of throughput.
The results realized after Load DynamiX professional services performed comparative testing of three different vendor storage arrays at the customer’s site included:
This public utility customer realized the following benefits after using Load DynamiX: