Enabling Complex Event Processing in NebulaStream
Abstract: Complex Event Processing (CEP) and Analytical Stream Processing (ASP) are two dominant paradigms for extracting knowledge from unbounded data streams. While CEP functionality is essential for detecting interesting patterns in vast data volumes, traditional CEP systems often face scalability limitations. To address these limitations, state-of-the-art solutions piggyback on cloud-optimized ASP systems for enhanced scalability and performance. The most common solution embeds CEP functionality as a single unary operator within the ASP execution pipeline. However, this design introduces conceptual bottlenecks, hindering the full utilization of ASP optimizations. To tackle this, we analyzed the synergies between both paradigms and proposed a general operator mapping in recent work. Our mapping translates CEP operators into their ASP counterparts, overcoming the bottlenecks of the unary operator solution. In this demonstration, weintegrate our mapping with a declarative pattern specification language tailored to the requirements of ASP systems. This integration automates the mapping process, seamlessly translating high-level pattern definitions into optimized ASP query plans. Our demonstration showcases this approach within the ASP system NebulaStream. It allows the audience to submit declarative CEPpatternsviaits UIandexplorethecorrespondingqueryplans resulting from our mapping. Additionally, we guide the audience through key optimization opportunities enabled by our mapping, which are unattainable with the unary operator solution.
