I was asked to help determine if Drools is capable of high volume processing. So I in return asked what do we mean by high volume. They gave me the following: 20,000 files 5 different rulesets expected 80 rules per set (approximated) 500GB total mem in data Drools will be running on an AWS t3.2xlarge Machine specs are: 32 GB Ram 8 CPUs 120 GB storage Because of the AWS aspect the host machine will be able to grow if required, not currently looking to use AWS Flink because of other considerations. Basic rules are one of two types: Does this data have a name tag with a value? Return T if true Is the name NOT one of these values: [a, b, c, d]? Return T if true The rules are mainly on the validation side of things but based upon failed validation routing of the data changes and reporting of the failure occurs. With this information, can anyone suggest how to theoretically show Drools can or cannot possibly handle the workload? Earlier engines using RETE seemed to wilt under large datasets but could not find performance related info on Drools 8.X.X. Full disclosure, I just started learning about Drools two days ago. FWIIW, I did look over existing articles and didn't see any that offered a format or template to follow for evaluation. Thank you in advance for your time and effort on my behalf!! Continue reading...
