You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Multimodal inputs in the DraftValidation class #394
Search for duplicates among the existing issues (both open and closed).
Proposal
Continuing on the theme of multimodal inputs, I thought it'd be really cool if the DraftValidation class could support multimodal inputs (images and PDF), just as Validate.prompt() now does. A rough sketch of how that would work, drawing inspiration from the How DraftValidation Works steps:
A statistical summary of your data is generated using the DataScan class.
This summary is converted to JSON format and sent to your selected LLM provider.
NEW: You provide the DraftValidation class with an image or PDF file describing what the data should look like. For example, the image could be a schema diagram, while the PDF could outline the project configuration elements that the data should conform to.
The LLM uses the summary and multimodal input along with knowledge about Pointblank’s validation capabilities to generate a validation plan.
The result is returned as executable Python code that you can use directly or modify as needed
Happy to get feedback from you @rich-iannone, and iterate. I'd love to implement this.
Activity