The Transaction Processing Performance Council (TPC), a consortium that develops benchmarks to verify server and data center performance and that includes major companies such as AMD, Intel e IBM, accused NVIDIA of violating its Fair Use Policy. At its GTC Fall 2020 virtual event last year, the Californian company unveiled a paper titled State of RAPIDS: Bridging the GPU Data Science Ecosystem. In the latter, NVIDIA demonstrated the benefits of its RAPIDS suite of libraries with GPU acceleration support for data science workflows over competing hardware and software platforms.
In addition, the company had compared the performance of its GPUs under similar workloads as the TPCx-BB, a TPC analytics benchmark that measures the performance of Hadoop-based Big Data systems. The benchmark runs 30 analytical queries in a retailer context with physical and online stores. Queries use SQL for structured data and machine learning algorithms for semi-structured and unstructured data. The TPCx-BB benchmark workloads are accurate and subject to TPC fair use policies.
The GPU giant said its platform “it had beaten the record of the standard analysis benchmark known as TPCx-BB by nearly 20 times“. However, NVIDIA did not run TPC’s intended workloads, but instead employed similar ones, which violates TPC’s policies and makes such comparisons invalid. However, the company had marked the version of the TPCx-BB benchmark used as “unofficial”.
Mike Brey, chairman of the TPC Steering Committee, said:
The TPC actively encourages the publication of TPC results by all organizations, including the press, market researchers, financial analysts and non-profit organizations. However, to ensure that users and readers of results receive a fair and complete representation of the data, the TPC requires that all users follow the Fair Use rules, described in the policies, when posting or advertising the results.
The TPC is currently working with NVIDIA to correct the problem.
Looking for a new PSU to power your next GPU? Corsair RM750X, 750W modular power supply, is available on Amazon.