TPC reference procedures and TPMC values - how to avoid misunderstanding today when using performance metrics, is a colorful world. The user wants to have a metric that can quantify the performance of the computer system as the basis for the selection. The author worked in the United States for several years of computer performance evaluation work, deeply experienced that the performance of the computer is difficult to evaluate by one or two measures, and any metric has its own advantages, especially when the user understands the performance metrics Not deep, it is easy to introduce some misunderstandings, and even the conclusion of the performance error. This article uses the TPC reference process as an example to give some practical recommendations to help users avoid entering these misunderstandings. First, what is TPC and TPMC? TPMC values are widely used at home and abroad to measure transactional processing capabilities of computer systems at home and abroad. But what is the TPMC value? The author has asked this problem with some users, salesmen and even some foreign companies, but the accuracy of the answer is far from the popularity of the TPMC value. This measure of TPMC is often misidentified as TPM or TPMC. 1, TPC TPC (TransactionProcessing PerformanceCouncil, Transaction Performance Committee) is a non-profit organization created by 10 member companies, headquartered in the US. The organization is open to the world, but so far, most members are beautiful, Japan, and Western Europe. The TPC member is mainly computer hardware and software manufacturers, rather than computer users, its functionality is the standard specification, performance and price measurement of the Business Application Baseline (Benchmark), and manages the release of the test results. The TPC publication is open and can be obtained through the network (http://www.tpc.org). The TPC does not give the code of the baseline, and only the standard specification of the reference process is given. Any manufacturer or other tester can optimally construct its own system (test platform and test procedure) according to the specification. In order to ensure the objectivity of the test results, the testers must be submitted to the TPC set of complete reports, including the detailed configuration of the measured system, classification price, and the total cost of five-year maintenance fees. price. The report must be verified by the TPC authorized auditor (TPC itself does not do audit). Now there are only a few auditors in the world, all in the United States. 2, TPMC TPC has introduced four sets of reference procedures, known as TPC-A, TPC-B, TPC-C and TPC-D. Among them, A and B are outdated, no longer used. TPC-C is a reference process for online transaction processing (OLTP), and TPC-D is a reference process for decision support (DecisionSupport). TPC is about to introduce TPC-E, as a baseline program for large enterprise (Enterprise) information services. TPC-C simulates a wholesaler's goods management environment. The wholesale company has N warehouses, and each warehouse is supplied in 10 regions, of which each region is 3,000 customers. There are 10 terminals in each warehouse, each terminal for use in a region. When running, 10 × N terminal operators send a five-class request to the company's database. Since all the goods are not possible in a warehouse, there are some requests to be sent to other warehouses, so the database is logically distributed. N is a variable parameter that can change N to obtain the best test effect. TPC-C uses three performance and price measures, with performance by TPC-C throughput, and units are TPMC. TPM is a referusion of Transactionsper Minute; C refers to the C baseline in the TPC. It is defined as a new order number of system processing per minute. It should be noted that while processing new orders, the system will handle other four types of transaction requests in Table 1 requirements.
As can be seen from Table 1, the new order request cannot exceed 45% of the full transaction request, so when a system has a system of 1000TPMC, it is more than 2,000 requests per minute. The price refers to the total price of the system, the unit is the dollar, and the price performance ratio is defined as the total price ÷ performance, and the unit is $ / tpmc. Second, how to measure the performance and price of computer systems When system selection, we don't forget that we are a specific application selection system for a particular user environment. Don't blindly use "International General". In the field of performance evaluation, the more common metrics are often inaccurate. As far as I know, some big users of the United States never believe in any "international general" metrics, but flowers as energy, such as 5% of the budget, use their own application to test the system, decide to select. When using any performance and price metrics, you must understand the definition of this measure, and how it is in what system configuration and operational environment, how to explain its meaning. Below we are better to discuss three ways. 1. In the real environment, the most ideal way to run actual applications is to engage in a pilot, requiring manufacturers or system integrators to cooperate with the system (including platform, software, and operational processes) to truly trial operation in an actual user point. In this way, the user can not only see the actual performance, but also observe whether the system is stable and reliable, it is convenient to use, whether the service is thoughtful, whether the configuration is sufficient, all the price is reasonable. If a department needs to purchase a group of systems, this way should be preferred as the first choice, because it is not only the most accurate, stable, often most efficient, users can also rent a system as a pilot. The measured value obtained in this way often has a clear and actual meaning. 2. Use user-defined base programs if the first way is not feasible for some reason, users can define a set of application benchmarks that contain their own actual application environment. I will give two examples: In recent years, since the R / 3 software is an application layer software, SAP's benchmark procedures have received more and more foreign companies; the China Taxation General has also developed their own benchmark procedures to help taxation The system performs computer selection. This approach is especially important in China because China's information system has specializes. 3. Use a general reference program If the first and second types are not line, the general reference process such as TPC-C is used, which is an approximate method. Therefore, the TPMC value can only be used as a reference. We should pay attention to the following: (1) Do the actual application is in conforming to the baseline procedure to develop in the United States, and China's enterprises and institutions are often different from the United States (I am afraid should not or not Maybe the same). When using TPC-C, we should clearly know: Is my application complies with wholesaler models? If the transaction request is approximate to Table 1? Is the requirements for the response time to meet table 1? If not, the reference value of the TPMC value Not too big. (2) Interpretation of TPC metrics The TPC reference process is used to measure the system rather than the host, and the manufacturer must fully optimize their measured systems. The "system" here includes host, peripherals (such as hard disk or RAID), host operating system, database software, client computer, and its operating system, database software, and network connections. In many manufacturers' TPC test systems, the price of the host is only 1/4 or smaller in the total price of the system, and the price of the hard disk may account for more than 1/3 of the total price, because the TPC -C requires the measured system to be saved. 180 days of business records. If the same host is used in the user's environment, the TPMC value of the manufacturer is not significant because the user's actual system is not the same as the manufacturer's system for TPC testing. When the same host is used in different systems, the TPMC value may have a considerable change, and now many users have not realized this. I will give an example.
