KubeCon + CloudNative North America 2023

The employment of a tapping filter is extensively prevalent in microservice architecture to monitor both upstream and downstream traffic, particularly when employing envoy as the routing entity amidst numerous upstream and downstream services, particularly in cases involving TLS. For Admin streaming, main thread becomes bottlenecked due to the accumulation of TraceWrappers from the worker threads. Consequently, XDS updates may experience throttling. Therefore, this solution is unsuitable for high traffic rates. The implementation for streaming Grpc Sink for transport socket level tapping aims to resolve these problems and to provide a set of counters representing the traced traffic and to provide ConnectionInfo cache replay mechanism. Take it a step further, given tapping filter can be a memory copy intensive scenario for CPU, we introduce memory copy lib to offload the work to hardware accelerator for memory copy.