How to use Document Understanding AI Service in Process Automation

Recently, Oracle added a new Document Understanding feature with OCI Process Automation.

In Process Automation forms, intelligent document processing is implemented with the Document Understanding control that uses out-of-the-box pre-trained AI models from OCI Document Understanding AI service to automatically detect, classify, and extract texts and objects from uploaded documents.

Now you can upload your document like a passport or driver’s license and this service automatically extracts data. In real-life scenarios, we used this service where we had to show our passport, driver’s license, or any other doc.

Like hotel check-in, rental car, hospital, visa service, etc.

Another example, I still remember during the COVID period, we had to use the ArriveCAN app to enter Canada which scanned our passports to extract all information.

So let’s test this in our process automation forms. In my previous post, I created a business process for the “Time Off Request application“. You can see that BLOG here.

This is not the best case to use document understanding as this is just a time off request, but this is just to show you how we can use this service with our business process.

So let me open the web form that I developed in my last blog, and you can see on the right below there is AI service Document Understanding.

Now let’s drag and drop the document understanding to our web form canvas.

Select the control and edit its properties on the left side in the General tab, I label it “Upload Document”

As you can see it only accepts the below file types as of now. Oracle might add more types later.

Now click on the Document tab in properties next to the General tab. Here you can see only these 2 Document types supported: Passport or Driver’s license.

I select Passport. As soon as I select passport as the document type, it will create the data object: passport with related definitions such as first name, last name, country, and so on.

The data object and data definitions are displayed under the Data section.

Now select the Generate Control property to automatically generate controls for the created data definitions.

Under the messages section if we expand we will see all the default messages that will be displayed, if required we can edit those messages.

Now there is a styling tab, I am not making any changes there.

Now you can click on the Preview button on top to just see what it will look like.

Now let’s activate this from the top Activate button and click on Override. it will deactivate the old version and create a new snapshot.

Now click on Test in Workspace

click on the Submit Time off Request and the form is open for employees to fill up information.

Now the fun part will start, I fill in all the information and then I have my passport copy on my laptop in .PNG format which I drag and drop in the form, and within a few seconds you will see all information automatically filled in the form from my passport.

you will also see this message.

Now we can submit the request for Team lead approval. Now the process is the same as I showed in my last Blog. I just wanted to test this new cool feature with Process Automation.