Use Registered IO + IOCP

[benaadams]

Registered RIO //build/ announce from 2011
http://channel9.msdn.com/events/Build/BUILD2011/SAC-593T

Microsoft Windows 8 and Windows Server 2012 introduce new Windows Sockets programming elements.

A set of high-speed networking extensions are available for increased networking performance with lower latency and jitter. These extensions targeted primarily for server applications use pre-registered data buffers and completion queues to increase performance.

The following are new Windows Sockets functions added to support Winsock high-speed networking Registered I/O extensions:

https://msdn.microsoft.com/en-us/library/windows/desktop/ms740642(v=vs.85).aspx

[benaadams]

Now have a ropey managed code implementation that needs some code cleaning up; but on local loopback; would be interested to see on test rig:

AspNet5

C:\Users\Ben\Downloads\httpd-2.4.12-x86-r2\Apache24\bin>ab -c 8 -k -n 500000 htt
p://127.0.0.1:5002/
This is ApacheBench, Version 2.3 <$Revision: 1638069 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 50000 requests
Completed 100000 requests
Completed 150000 requests
Completed 200000 requests
Completed 250000 requests
Completed 300000 requests
Completed 350000 requests
Completed 400000 requests
Completed 450000 requests
Completed 500000 requests
Finished 500000 requests

Server Software: Microsoft-HTTPAPI/2.0
Server Hostname: 127.0.0.1
Server Port: 5002

Document Path: /
Document Length: 334 bytes

Concurrency Level: 8
Time taken for tests: 90.568 seconds
Complete requests: 500000
Failed requests: 0
Non-2xx responses: 500000
Keep-Alive requests: 0
Total transferred: 256500000 bytes
HTML transferred: 167000000 bytes
Requests per second: 5520.74 #/sec
Time per request: 1.449 ms
Time per request: 0.181 [ms](mean, across all concurrent requests)
Transfer rate: 2765.76 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.2 0 24
Processing: 0 1 0.5 1 35
Waiting: 0 1 0.5 1 34
Total: 0 1 0.5 1 35

Percentage of the requests served within a certain time (ms)
50% 1
66% 2
75% 2
80% 2
90% 2
95% 2
98% 2
99% 3
100% 35 (longest request)

NativeHttpServer

C:\Users\Ben\Downloads\httpd-2.4.12-x86-r2\Apache24\bin>ab -c 8 -k -n 500000 http://127.0.0.1:5001/
This is ApacheBench, Version 2.3 <$Revision: 1638069 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 50000 requests
Completed 100000 requests
Completed 150000 requests
Completed 200000 requests
Completed 250000 requests
Completed 300000 requests
Completed 350000 requests
Completed 400000 requests
Completed 450000 requests
Completed 500000 requests
Finished 500000 requests

Server Software: Dummy
Server Hostname: 127.0.0.1
Server Port: 5001

Document Path: /
Document Length: 10 bytes

Concurrency Level: 8
Time taken for tests: 3.723 seconds
Complete requests: 500000
Failed requests: 0
Keep-Alive requests: 500000
Total transferred: 64000000 bytes
HTML transferred: 5000000 bytes
Requests per second: 134305.20 #/sec
Time per request: 0.060 ms
Time per request: 0.007 [ms](mean, across all concurrent requests)
Transfer rate: 16788.15 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 0 0 0.2 0 3
Waiting: 0 0 0.2 0 3
Total: 0 0 0.2 0 3

Percentage of the requests served within a certain time (ms)
50% 0
66% 0
75% 0
80% 0
90% 0
95% 1
98% 1
99% 1
100% 3 (longest request)

NativeRIOHttpServer

C:\Users\Ben\Downloads\httpd-2.4.12-x86-r2\Apache24\bin>ab -c 8 -k -n 500000 http://127.0.0.1:5001/
This is ApacheBench, Version 2.3 <$Revision: 1638069 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 50000 requests
Completed 100000 requests
Completed 150000 requests
Completed 200000 requests
Completed 250000 requests
Completed 300000 requests
Completed 350000 requests
Completed 400000 requests
Completed 450000 requests
Completed 500000 requests
Finished 500000 requests

Server Software: -RIO-
Server Hostname: 127.0.0.1
Server Port: 5001

Document Path: /
Document Length: 10 bytes

Concurrency Level: 8
Time taken for tests: 3.533 seconds
Complete requests: 500000
Failed requests: 0
Keep-Alive requests: 500000
Total transferred: 64000000 bytes
HTML transferred: 5000000 bytes
Requests per second: 141531.08 #/sec
Time per request: 0.057 ms
Time per request: 0.007 [ms](mean, across all concurrent requests)
Transfer rate: 17691.38 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 0 0 0.2 0 13
Waiting: 0 0 0.2 0 13
Total: 0 0 0.2 0 13

Percentage of the requests served within a certain time (ms)
50% 0
66% 0
75% 0
80% 0
90% 0
95% 1
98% 1
99% 1
100% 13 (longest request)

[benaadams]

Needs work, but first attempt: https://github.com/benaadams/benchmarks/tree/Registered-IO-Server/src/NativeRIOHttpServer