Skip to main content

Data ingestion into Knowledge base

KB AI-agent can utilize ingested data to provide more informative responses. There are multiple entry points through which data can be fed into the AI-agent.

Upload website URLs​

Easily upload your website URLs directly to our platform. When the AI-agent encounters a question related to the website, it will provide relevant answers.

To upload your website URL, follow:

  1. Go to Knowledge base > Files > click + Add URL.

  2. Enter the website URL and click Save.

    image

This handles all sub URLs automatically, to improve accuracy, add more URLs manually under Upload documents.

note

Redirection links(URL) cannot be displayed within the summarized answer. The best practice for LLMs is to avoid generating links in responses or summarizations. This precaution is taken because LLMs can potentially miss characters like "-", which could break the link or even direct users to unsafe pages, posing a security risk. Therefore, it's safer to refrain from including links altogether.

Manual data ingestion​

Upload documents from local system​

Upload specific documents to enable the AI-agent to identify relevant questions and provide accurate answers from them. You can upload Word, PPT, PDF and Txt files.

To upload files from your system, follow:

  1. Go to KB > Upload documents > Your computer.

  2. Click Upload document to upload your documents here. Currently we support file sizes upto 20MB.

    drawing

  3. Enable Generate Q&A to let the AI-agent to respond to users questions with answers that resemble human-like responses.

  4. Enable Enable table parsing to allow the AI-agent to extract structured data from tables in a document or a webpage.

  5. Choose the langauge of the uploaded file and click Add.

note
  • Our team is still in process of fine tuning the feature so while uploading the files, it's preferable to have data in the form of bullet points or paragraphs rather than tables.
  • When docs are in indexing/pending state, you have to wait in queue. Ensure you dont enable table parsing or QnA generation when you index.
  • If the PDFs belong to any language other than English, the end results might not be perfect. Please post your concerns on community.yellow.ai , our product experts will help you.

Add acronyms​

You can boost AI-agent understanding and search accuracy via Acronyms.

In the Acronym section, you can enter common phrases for specific terms. This helps the AI-agent understand and fetch accurate results from the documentation, even when users use abbreviations. For example, users might use WA for WhatsApp. If you add this acronym the AI-agent can understand it as WhatsApp whenever a user uses it.

To add acronyms, follow:

  1. Go to Knowledge base > Files > Manage acronyms.

  2. Click Add new acronym > + Acronym name, enter the name of the specific term and in Acronyms enter the commonly used utterances for that term.

    drawing

  3. Click Add list item.

  4. You can edit the entered acronyms by selecting and deleting them or by clicking on the three dots on the right side for further modifications.

    image

Upload specific URLs/subdomain URLs​

You can provide info to users from a specific URL/sub-URLs, this enhances the response accuracy. To add multiple URLs, follow:

  1. Go to Knowledge base > Files > Upload documents > Upload URL.

  2. Enter the URL and click Upload. To add furthermore URLs, click Add another URL.

    drawing

Upload documents via. third-party applications​

You can upload documents/folders from third-party applications (such as AWS S3 and Sharepoint).

These documents are fetched one time from the integrations and are not auto-synced frequently.

AWS S3 integration​

To upload folders/files from AWS S3 to cloud platform, follow:

  1. Go to Knowledge base > Files > Upload documents > AWS S3.

  2. Fill in the fields and click Sync folders select the folder from the chosen bucket to sync with.

  3. Click Upload.

Sharepoint integration​

To upload folders/files from Sharepoint to cloud platform, follow:

  1. Go to Knowledge base > Files > Upload documents > Sharepoint.

  2. Fill in the fields and select the folder from the chosen bucket to sync with.

  3. Click Upload.

Additional options for uploaded documents​

For each uploaded document, you have the following customization options:

  • Edit tags: Add tags for identification and categorization of specific documents.

  • Edit properties:

    • File name: Modify the file name as needed.
    • Redirection URL: When activated, redirects to a designated URL while simultaneously displaying the search results from the doc-cog.

      Tags and properties are particularly useful when utilizing the Document Search Node > Metadata filters.

  • Preview: View the document, providing options to explore the uploaded content.

    • Generate QnA: Click to generate Q&A, acting similarly to FAQs. You can access this in Train > Documents > QnA Extract.

  • Delete: Remove the document.

Search and filter uploaded documents​

When you have uploaded multiple documents and you quickly want to find it and make some change, you can use search option by typing the file name. image

You can locate the uploaded documents based on the following parameters using Filters:

  1. Click Filters and fill in the following fields.

    • File name: Type the name of the file
    • Source: Select the source from which the file was uploaded to the platform
    • Status: Select the status of the uploaded file
    • Tags: Type the added tags

  2. Click Apply filter.