Frequently asked questions

Are Annotate and Active Projects the same?

The short answer is no. Here are the differences:

  • Annotate Projects are made of Datasets (data), Ontologies, and Workflows. Once Annotation Projects get underway, labels and comments also become part of the Annotate Projects.

Active is integrated with the Encord Plaform, which by extension means Active is also integrated with Annotate. Active Projects import portions of Annotate Projects. Active projects import Annotate Project data, Ontologies, labels, and comments but not Workflows.


What is a quality metric?

A quality metric is a function that can be applied to your data, labels, and model predictions to assess their quality and rank them accordingly.

Encord Active uses these metrics to analyze and decompose your data, labels, and predictions.

Here is a blog post on how we like to think about quality metrics.

To learn more about quality metrics, go here.

Quality metrics are not only limited to those that ship with Encord Active. In fact, the power lies in defining your own quality metrics for indexing your data just right. Here is the documentation for writing your own metrics.


How do I write my own quality metrics?

See our documentation on writing your own metrics.


How do I use Encord Active for active learning?

Encord Active supports the active learning process by allowing you to

  1. Explore your data to select what to label next
  2. Employ acquisition functions to automatically select what to label next
  3. Find label errors that potentially harm your model performance
  4. Sending data to Encord's Annotation module for labeling
  5. Automatically decompose your model performance to help you determine where to put your focus for the next model iteration
  6. Tag subsets of data to set aside test sets for specific edge cases for which you want to maintain your model performance between each production model

For detailed information on active learning and the role of Encord Active, you can refer to our documentation on Active Learning within Encord Active.



How do I import my model predictions?

Active supports importing predictions in the following ways:


How can I do dataset management with Encord Active?

Use Collections in your Active Projects to handle all your Project data (not just Dataset) needs.

Once you've created a Collection, you can send the Collection to Annotate in the following ways:

  • Apply the Collection directly to your exisitng Annotate Projects

  • Create a new Dataset and attached Annotate Project off of your Collection

  • Apply classifications to all frames/images in your Collections directly to your existing Annotate Projects


How do I version my data and labels through Encord Active?

While you can version your data and labels using Active, Annotate supports data versioning and label versioning.

You can use Collections to version your Projects using Active.


How do I use Encord Active to find label errors?

Use Label Overview shortcuts and Label Quality Metrics to find label errors.


Can I use Encord Active without an Encord account

You need an Annotate account to use Active.


Does data stay within my local environment/cloud?

Yes!

If your data is stored in cloud storage (AWS, GCP, Azure, OTC), your data remains there.


How do I add my own embeddings?

Please contact your Encord representative for more information to add embeddings to Active.


What should I do if I encounter an error?

If you come across an error, don't worry! We're here to assist you.
Reach out to us on Slack or shoot us an email, and we'll promptly address your concern.

Additionally, we greatly appreciate it if you could report the issue on GitHub. Your feedback and bug reports help us improve Encord Active for everyone.