================================================================================================
Benchmark to measure CSV read/write performance
================================================================================================

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Parsing quoted values:                    Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
One quoted string                                 46299          46385         148          0.0      925970.7       1.0X

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Wide rows with 1000 columns:              Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Select 1000 columns                               73622          74098         777          0.0       73621.6       1.0X
Select 100 columns                                34148          34201          47          0.0       34147.9       2.2X
Select one column                                 29519          29596          78          0.0       29519.4       2.5X
count()                                            4756           4833          67          0.2        4756.3      15.5X
Select 100 columns, one bad input field           51979          52036          74          0.0       51979.0       1.4X
Select 100 columns, corrupt record field          57043          57321         339          0.0       57043.2       1.3X

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Count a dataset with 10 columns:          Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns + count()                       17428          17469          40          0.6        1742.8       1.0X
Select 1 column + count()                         11682          11703          31          0.9        1168.2       1.5X
count()                                            2787           2800          13          3.6         278.7       6.3X

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Write dates and timestamps:               Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps                     1241           1264          22          8.1         124.1       1.0X
to_csv(timestamp)                                  9455           9520          84          1.1         945.5       0.1X
write timestamps to files                          8592           8608          23          1.2         859.2       0.1X
Create a dataset of dates                          1463           1470           8          6.8         146.3       0.8X
to_csv(date)                                       6328           6333           4          1.6         632.8       0.2X
write dates to files                               5112           5115           3          2.0         511.2       0.2X

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Read dates and timestamps:                Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files                     1781           1800          20          5.6         178.1       1.0X
read timestamps from files                        29126          29146          18          0.3        2912.6       0.1X
infer timestamps from files                       60051          60101          47          0.2        6005.1       0.0X
read date text from files                          1833           1850          27          5.5         183.3       1.0X
read date from files                              16687          16711          22          0.6        1668.7       0.1X
infer date from files                             35526          35565          55          0.3        3552.6       0.1X
timestamp strings                                  1948           1959          14          5.1         194.8       0.9X
parse timestamps from Dataset[String]             33202          33302         138          0.3        3320.2       0.1X
infer timestamps from Dataset[String]             64771          64820          57          0.2        6477.1       0.0X
date strings                                       2336           2346           9          4.3         233.6       0.8X
parse dates from Dataset[String]                  20674          20698          22          0.5        2067.4       0.1X
from_csv(timestamp)                               32259          32649         504          0.3        3225.9       0.1X
from_csv(date)                                    18588          18622          31          0.5        1858.8       0.1X

OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Filters pushdown:                         Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
w/o filters                                       15982          15983           1          0.0      159816.5       1.0X
pushdown disabled                                 15989          16007          16          0.0      159888.2       1.0X
w/ filters                                         1161           1174          11          0.1       11612.3      13.8X


