Drools 5 Case Study 2 – Complex Event Processing

In my previous post Drools 5 – Complex Event Processing, I gave introduction to Drools Fusion module. In the current post, I would like to demonstrate Drools Fusion capabilities.

As an example chosen for the current article, I decided to use a scenario when an insurance firm rewards its policy members. The members are rewarded when they keep a low average of claimed money under the threshold set on their account over a period of time.

In other words, if the policy member had last five claims average and average of claims during last ninety (90) days lower than the threshold limit – he/she will be eligible for a reward.

Drools allows us to test for these conditions by applying the sliding window concept. So to obtain a claim average for a particular period in time, I will use time based sliding window. To obtain an average of last five claims, I will use length based sliding window.

Before I begin, I would like to say that the source code for this article is available as attachment, the download link is at the bottom.

Ok, lets begin. Below is my POJO Account:

[java]
public class Account {
private String number = "";
private double threshold = 0.00;

public Account() {
super();
}

public String getNumber() {
return number;
}

public void setNumber(String number) {
this.number = number;
}

public double getThreshold() {
return threshold;
}

public void setThreshold(double threshold) {
this.threshold = threshold;
}
}
[/java]

The following is my implementation of the claim event POJO:

[java]
public class ClaimApprovedEvent implements Serializable {

private static final long serialVersionUID = 1L;
private String accountNumber = "";
private double amount = 0.00;

public ClaimApprovedEvent(String accountNumber, double amount) {
this.accountNumber = accountNumber;
this.amount = amount;
}

public String getAccountNumber() {
return accountNumber;
}

public void setAccountNumber(String accountNumber) {
this.accountNumber = accountNumber;
}

public double getAmount() {
return amount;
}

public void setAmount(double amount) {
this.amount = amount;
}
}
[/java]

This event represents a claim event when a policy member has claimed some money. Event contains policy member account number and the claim amount. These events, I will be “feeding” in to the KnowledgeSession as facts. Yes, they are play a role knowledge facts in Drools.

Having said that I want to point out that all events are facts, but not all facts are events. I know it maybe a little bit confusing, but if you read Drools 5.0 doco it will become more clearer to you.

To give some information about it – events almost never change state in Drools (almost means it is still possible to change the state of event), therefore they are immutable.

Events simply hold information about something that has already happened and because you cannot change what has already happened – events are immutable. Events also allow the use of sliding windows.

The following is implementation of a POJO, that plays a role of a common data structure for rules to use at run time. It is one of the new features that available in Drools 5. Keep in mind – that this is not a knowledge fact, but just a data structure.

This POJO is an internal type, therefore there is no need to create new instance of this class. The object will only be created at run time, when the knowledge package is compiled (In my tester class I show how to do it). For now, we just have to add POJOs declaration to DRL, and to have the source file present. Later on, you will see how the declaration in DRL is done:

[java]
public class AccountInfo {

private String accountNumber = "";
private double aveOfLastClaims = 0.00;
private double aveForPeriod = 0.00;
private boolean eligibleForBonusClaims = false;
private boolean eligibleForPeriodicBonus = false;

public AccountInfo() {
super();
}

public String getAccountNumber() {
return accountNumber;
}

public void setAccountNumber(String accountNumber) {
this.accountNumber = accountNumber;
}

public double getAveOfLastClaims() {
return aveOfLastClaims;
}

public void setAveOfLastClaims(double aveOfLastClaims) {
this.aveOfLastClaims = aveOfLastClaims;
}

public double getAveForPeriod() {
return aveForPeriod;
}

public void setAveForPeriod(double aveForPeriod) {
this.aveForPeriod = aveForPeriod;
}

public boolean isEligibleForBonusClaims() {
return eligibleForBonusClaims;
}

public void setEligibleForBonusClaims(oolean eligibleForBonusClaims) {
this.eligibleForBonusClaims = eligibleForBonusClaims;
}

public boolean isEligibleForPeriodicBonus() {
return eligibleForPeriodicBonus;
}

public void setEligibleForPeriodicBonus(boolean eligibleForPeriodicBonus) {
this.eligibleForPeriodicBonus = eligibleForPeriodicBonus;
}
}
[/java]

…and the following is the DRL:

[java]
package net.javabeansdotasia.casestudy.pojo;

import net.javabeansdotasia.casestudy.pojo.ClaimApprovedEven
import net.javabeansdotasia.casestudy.pojo.Account;

declare ClaimApprovedEvent
// declare a fact type as an event, default is ‘fact’
@role( event )
end

// Decalare common data structure for all rules to use
declare AccountInfo
accountNumber : String
aveOfLastClaims : Double
aveForPeriod : Double
eligibleForBonusClaims : Boolean
eligibleForPeriodicBonus : Boolean
end

rule "FiveLastClaims"
dialect "mvel"
no-loop true
salience 100

when
$account : Account()

//check if the average of last five claims is less
//than the account threshold
$aveOfLastClaims : Number($account.threshold > doubleValue )
from accumulate(
ClaimApprovedEvent(
accountNumber == $account.number,
$amount : amount
)
over window:length( 5 ) from entry-point ClaimStream,
average($amount)
)

//the member must not have received eligibility
//for last claim bonus yet
$accountInfo : AccountInfo(accountNumber == $account.number, eligibleForBonusClaims == false )

then modify($accountInfo) {
setAveOfLastClaims($aveOfLastClaims);
setEligibleForBonusClaims(true);
};
end

rule "NinetyDaysPeriod"
dialect "mvel"
no-loop true
salience 90

when
$account : Account()

//check if the average of claims for period is less
//than the account threshold
$aveForPeriod : Number($account.threshold > doubleValue )
from accumulate(
ClaimApprovedEvent(
accountNumber == $account.number,
$amount : amount
)
over window:time( 90d ) from entry-point ClaimStream,
average($amount))

//the member must have eligibility for last claim bonus and
//the member must not have received eligibility for
//periodic bonus yet
$accountInfo : AccountInfo(accountNumber == $account.number, eligibleForBonusClaims == true, eligibleForPeriodicBonus == false)

then modify($accountInfo) {
setAveForPeriod($aveForPeriod);
setEligibleForPeriodicBonus(true);
};
end

rule "EligibleForVoucher"
dialect "mvel"
no-loop true
salience 80

when
$account : Account()

//the member must have eligibility for last claim bonus and
//the member must have eligibility for periodic bonus
$accountInfo : AccountInfo(
accountNumber == $account.number, eligibleForBonusClaims == true, eligibleForPeriodicBonus == true)
then
System.out.println("Notifying policy member…");
System.out.println("Dear member, you have claimed " + "in average $" +
$accountInfo.aveOfLastClaims + " during last five claims, which is " +
"under the account threshold of $" + $account.threshold);

System.out.println("Dear member, you have claimed " + "in average $" +
$accountInfo.aveForPeriod + " during last 90 days, which is "+
"under the account threshold of $" + $account.threshold);

System.out.println("You are eligible for a holiday!");
end
[/java]

Lets have a look what does this DRL do:

1. Modifying existing type by specifying that ClaimApprovedEvent is an event (line 6). To allow Drools to process events, we have to set that the fact is of type event
2. Declaring new type that plays the role of a common data structure (line 12). This is the declaration that I was talking about previously.
3. rule “FiveLastClaims” obtains an average of last five event claims and compares it to the account threshold. If the rule return true, the AccountInfo is updated with new data for other rules to use.
4. rule “NinetyDaysPeriod” obtains an average claim totals over a period of ninety (90) days and compares it to the account threshold. If the rule return true, the AccountInfo is updated with new data for other rules to use
5. rule “EligibleForVoucher” checks if the account owner has both eligibility for a periodic bonus and last five claim bonus, if true – the policy member will be eligible for a reward

The following is the snippet code from my Tester class where I show how to I load claim events over a period of time into the Knowledge session entry point (once again to remind: please refer to the source code attached for more information):

[java]
SessionPseudoClock clock = session.getSessionClock();
WorkingMemoryEntryPoint claimStream = session.getWorkingMemoryEntryPoint("ClaimStream");
claimStream.insert(new ClaimApprovedEvent(account.getNumber(), 12.00));
clock.advanceTime(80, TimeUnit.DAYS);
claimStream.insert(new ClaimApprovedEvent(account.getNumber(), 46.00));
clock.advanceTime(15, TimeUnit.DAYS);
claimStream.insert(new ClaimApprovedEvent(account.getNumber(), 60.00));
clock.advanceTime(45, TimeUnit.DAYS);
claimStream.insert(new ClaimApprovedEvent(account.getNumber(), 110.00));
clock.advanceTime(60, TimeUnit.DAYS);
claimStream.insert(new ClaimApprovedEvent(account.getNumber(), 20.00));
session.insert(account);
session.insert(accountInfo);
session.fireAllRules();
[/java]

Please note an entry point “ClaimStream”. Entry point plays a role of a partition in KnowledgeSession in Drools. Partitioning is also a new concept in Drools that makes KnowledgeSession multithreaded. You can have multiple entry points and choose where to insert the fact.

In the current example, I use only one partition (or entry point). If I would to use more than one, than I would have to enable multi-partitioning with the following code:

[java]
KnowledgeBaseConfiguration config = KnowledgeBaseFactory.newKnowledgeBaseConfiguration();
config.setOption(MultithreadEvaluationOption.YES);
[/java]

Have a read Drools Fusion manual, the team really gives a good cover of this concept.

I use SessionPseudoClock that allows me to test the rules by feeding claim events into the KnowledgeSession over a period of time. As you can see, after each event I move the clock forward, simulation submission of each claim event in different time.

The following is the program output:

[java]
Notifying policy member…
Dear member, you have claimed in average $49.6 during last five claims, which is under the account threshold of $70.0
Dear member, you have claimed in average $65.0 during last 90 days, which is under the account threshold of $70.0
You are eligible for a holiday!
[/java]

That’s it. In this example I showed how it is possible to process complex events over a period of time by applying sliding window concept.

Please note that the above example was tested by me and its working fine. I also included source files for the above example as Eclipse project. You can simply create a new Java project from this existing Ant build.xml file.

Also, I wanted to point out that in my Eclipse project setup my Drools binaries located under JAVA_HOME/lib/drools-5.0-bin/ (have a look at the build.xml)

I hope this was clear :)

Cheers

drools-case-study-2-CEP

Resources:

Drools JBoss Rules 5.0 Developer’s Guide July 2009

Drools 5 – Complex Event Processing

From Drools version 4 to version 5, the framework has undergone quite a few improvements. These include support for three additional business modeling techniques. So today, Drools is not only a rule engine, but much more than that.

One of these techniques is event processing. The module that added event processing capabilities to the framework is called Drools Fusion. It supports Complex Event Processing (CEP) and Event Stream Processing (ESP).

“…Complex Event Processing, or CEP, is primarily an event processing concept that deals with the task of processing multiple events with the goal of identifying the meaningful events within the event cloud. CEP employs techniques such as detection of complex patterns of many events, event correlation and abstraction, event hierarchies, and relationships between events such as causality, membership, and timing, and event-driven processes…”

http://en.wikipedia.org/wiki/Complex_Event_Processing

Drools Fusion utilizes event processing architecture that adds loose coupling to its components. In other words, one party can publish events and other party can listen to those events while unaware of the publishing party.

Event can represent a change in state, for example banking transaction or insurance claim that was processed. CEP deals with complex event processing. Complex event is a collection of simpler events. Please refer to the diagram below:

Drools - complex event processing

In my next post Drools 5 Case Study 2 – Complex Event Processing, I talk about CEP and how Drools applies its processing power to solve complex event problems.

Drools 5 Case Study 1- Writing DSL for DRL rule

One of the blog readers, who posted a comment in my previous post Drools – tutorial on writing DSL template asked to me to help him with creating DSL for the following rule, so I decided to use his example as a small case study:

For readability, I added some comments to the original rule:

[java]
rule ‘Rank accomodation name’
salience 90
when
//Matches every AccomodationBase
$accBase: AccomodationBase()

//Uses inline eval to evaluate that there is
//no AccomodationBase of type AccomodationRank
//in the session.

//To remind: inline eval evaluated only once
//and then it is cached by Drools.

not AccomodationBase(eval($accBase
instanceof AccomodationRank))

//Matches every AccomodationRank that has the same
//level and the description as the AccomodationBase
$accRank: AccomodationRank(
level == $accBase.level,
description == $accBase.description)
then
//Increments the score
$accRank.setScore($accRank.getScore()+1);
end
[/java]

For my solution, I created two POJOs, tester class DSL and DSLR files. The following is my DSL:

[java]
[when]AccomodationBaseObj = $accBase: AccomodationBase()
[when]There is Accomodation base object of type Accomodation rank = eval($accBase instanceof AccomodationRank)
[when]AccomodationRankObj = $accRank: AccomodationRank(level == $accBase.level, description == $accBase.description)
[then]IncrementScore = $accRank.setScore($accRank.score+1);
[then]PrintScore = System.out.println("Rank score: " + $accRank.score);
[then]PrintLevel = System.out.println("Base level: " + $accBase.level);
[/java]

and this is the DSLR file:

[java]
package net.javabeansdotasia.casestudy;

expander accomodation.dsl

import net.javabeansdotasia.casestudy.pojo.AccomodationBase;
import net.javabeansdotasia.casestudy.pojo.AccomodationRank;

rule "Rank"
dialect "mvel"
when
AccomodationBaseObj
not (There is Accomodation base object of type Accomodation rank)
AccomodationRankObj
then
IncrementScore
PrintScore
PrintLevel
end
[/java]

In the following class I load DSL and DSLR files in to the KnowledgeBuilder and get a KnowledgeBase object. Once I have the KnowledgeBase object, I can get StatefulKnowledgeSession or StatelessKnowledgeSession, depends on what I want to do.

[java]
package net.javabeansdotasia.casestudy.utils;

import org.drools.KnowledgeBase;
import org.drools.KnowledgeBaseFactory;
import org.drools.builder.KnowledgeBuilder;
import org.drools.builder.KnowledgeBuilderError;
import org.drools.builder.KnowledgeBuilderErrors;
import org.drools.builder.KnowledgeBuilderFactory;
import org.drools.builder.ResourceType;
import org.drools.io.ResourceFactory;

public class MyKnowledgeBaseFactory {
public static KnowledgeBase
createKnowledgeBaseFromDSL(String dslr,
String dsl) throws Exception {

KnowledgeBuilder builder =
KnowledgeBuilderFactory
.newKnowledgeBuilder();

//Attention!!!!
//Add DSL BEFORE DSLR
builder.add(
ResourceFactory.newClassPathResource(dsl),
ResourceType.DSL);

builder.add(
ResourceFactory.newClassPathResource(dslr),
ResourceType.DSLR);

KnowledgeBuilderErrors errors = builder.getErrors();

if (errors.size() > 0) {
for (KnowledgeBuilderError error : errors) {
System.err.println(error);
}
throw new IllegalArgumentException("Could not parse knowledge.");
}
KnowledgeBase knowledgeBase =
KnowledgeBaseFactory.newKnowledgeBase();
knowledgeBase.addKnowledgePackages(
builder.getKnowledgePackages());
return knowledgeBase;
}
}
[/java]

Below is my Tester class:

[java]
package net.javabeansdotasia.casestudy.test;

import net.javabeansdotasia.casestudy.pojo.AccomodationBase;
import net.javabeansdotasia.casestudy.pojo.AccomodationRank;
import net.javabeansdotasia.casestudy.utils.MyKnowledgeBaseFactory;

import org.drools.KnowledgeBase;
import org.drools.runtime.StatefulKnowledgeSession;

public class Test {

public static final void main(String[] args) {
try {
KnowledgeBase kbase =
MyKnowledgeBaseFactory
.createKnowledgeBaseFromDSL(
"accomodation.dslr",
"accomodation.dsl");
StatefulKnowledgeSession ksession =
kbase.newStatefulKnowledgeSession();
AccomodationBase accomBase =
new AccomodationBase(9, "Just Demo");
AccomodationRank accomRank =
new AccomodationRank(9, "Just Demo");
ksession.insert(accomBase);
ksession.insert(accomRank);
ksession.fireAllRules();
} catch (Throwable t) {
t.printStackTrace();
}
}
}
[/java]

As you may have noticed, in Drools 5 the process of loading the rule files (DSL and DSLR) and getting a working session is different to Drools 4. In Drools 5 there is a whole new set of APIs. Basically, main change is that Drools now is knowledge oriented, instead of rule oriented. It was a real step forward in order to support other forms of logic, such as work-flow and event processing. You can read about it in Drools 5.0 docs.

That it. Please note that the above example was tested by me and its working fine. I also included source files for the above example as Eclipse project. You can simply create a new Java project from this existing Ant build.xml file.

Also, I wanted to point out that in my Eclipse project setup my Drools binaries located under JAVA_HOME/lib/drools-5.0-bin/ (have a look at the build.xml)

Cheers

Drools – Tutorial on Writing DSL Template

Few months ago I wrote a post that describes an example that uses source DRL in conjunction with DSL template. In the current post, I want to describe and show with few examples how to write DSL template – whats allowed and whats not.

Now, having said that, I want to say that I am not planning to repeat the whole JBoss Rules manual – the Drools team done a great job. I just want to share from my personal experience, what I have come across while working with Drools when writing DSLs.

There are few upcoming changes coming in the future release of Drools (version 5) in terms of DSL. For example DSL will become more powerful in terms of regular expressions – it will be possible to include regexp in the DSL tokens. Edson Tirelli posted an article written by Matt Geis on Drools Blog, that talks about it and gives few examples.

Since I am working with Drools 4.0.7 these days, I will describe in the current post how to write DSLs for Drools 4.0.7.

Within a scope of Drools, DSL’s job to map (expand) DRL expressions written in natural language into underlying programming code.

When writing DSL there several basic DO’s and DONT’s you should be aware of:

  1. Don’t put closing semi-column at the end of DSL expression line:
    [when]Message status is {1} = m : Message(status == {1});
  2. Avoid different token names on the left hand side (before the “=”) and right hand side (after the “=”) of the DSL expansion:
    [when]Message status is {3} = m:Message(status == {1})
    [then]Log “{message}” = System.out.println(“{bobo}”);
  3. DSL expansion should be on one line. You can even have several expressions on the same line, but you cannot break the line. By putting expression on a new line will cause an exception during parsing:
    [when]Message id is {id} = m:Message(id == {id})
    [then]LogUpdate “{2}” = System.out.println(“{2}”);
    update(m);
    [when]Message status is {s} = m:Message(status == {s})
    [then]Log “{2}” =
    System.out.println(“{2}”);
  4. Avoid having DSLs with the same name. It can create a confusion. Remember that DSL is parsed from top to bottom, so when two DSLs with the same name exist, the top one will apply during expansion since it will be matched first:
    [then]SetStatus {s} = System.out.println({s});
    [then]SetStatus {s} = m.setStatus({s});
  5. If token has quotes on the left hand side of the DSL, then the token must have quotes on the right hand side of the DSL:
    [then]SetMessage {msg} = m.setStatus({msg});
  6. There is no room for typos:rule “set-hello”
    when
    True
    then
    SetMessage “Hello”
    end[then]SetMessag “{msg}” = m.setStatus(“{msg}”);
  7. Token names can be literal or numeric characters, or both:
    [then]Print1 “{1}” = System.out.println(“{1}”);
    [then]Print2 “{msg}” = System.out.println(“{msg}”);
    [then]Print3 “{23msg}” = System.out.println(“{23msg}”);
  8. If token on the left hand side has no quotes, and expression/function on the right hand side can accept parameter of type String, then the token can be placed between quotes on the right hand side:
    [then]PrintInteger {1} = System.out.println({1});
    [then]PrintInteger2 {1} = printingFunction({1});
  9. If you want to use declared variable in right hand side, make sure it is declared on the left hand side of the rule. Remember, DSL template is ONLY a template, it is a not a place to declare variables, declaration occurs only in DRL, DSL contains the expansion. Keep in mind that declaration and usage of the variable is per-rule basis:rule “set-hello”
    when
    Message
    then
    SetMessage “Hello”
    end[when]Message = m : Message() //declare and initialize ‘m’
    [then]SetMessage “{msg}” = m.setStatus(“{msg}”);
  10. White spaces before the “=” and after are allowed when writing a DSL line:
    [then]SetMessage “{msg}” = m.setStatus(“{msg}”);
  11. If you are using a function in the right hand side of the DSL of the expansion, then make sure you provide necessary imports in DRL source for all the objects the function is using. For example if your function gets a proxy to a JMS Queue from JBoss, then you have to include imports for all the objects associated with this operation, like you normally would do it in normal Java class. Also the function itself must be present in source DRL.
  12. Left hand side of the rule, can evaluate boolean function instead of expression:rule “CheeseType”
    when
    Cheese is of type “silton”
    then
    DoSomething
    endfunction boolean someEvaluatingFunction(Cheese cheese,String type) {
    if (cheese.getType().equals(type)) return true;
    else return false;
    }

    [when]Cheese is of type “{1}” = chz:Cheese() eval(someEvaluatingFunction(chz, “{1}”))
    [then]DoSomething = System.out.println(“Something”);

If you interested in additional examples of the DRL+DSL, you can have a look at another short example that I wrote sometime ago. Also, please dont forget to have a look at the JBoss Rules manual that i mentioned earlier.

Cheers