# What is Lodestar? Video labeling platform for computer vision model creation ### **The company** Lodestar was founded in 2019 in Silicon Valley with a vision to make it possible for everyone to benefit from intelligent systems. In order to achieve that goal we are building tools that anyone can use to create computer vision systems and automate repetitive tasks. We work with companies that want to automate repetitive processes so that they can provide a safer and more interesting work environment for their employees, higher quality products for their clients and better value to their shareholders. ### **The product** Lodestar is a complete management suite for developing computer vision models from video data. Our game-changing technology can help create production models dramatically faster than traditional AI workflows. #### Video annotation Everything you need to label a high-quality video dataset. Easily upload and navigate through hours of video or millions of images, manage annotators, create object categories or add custom metadata to annotations. #### Dataset management Experiment directly on the dataset while your labelers are working in the annotation tool. Stop wasting time creating and keeping track of dataset copies and manually slicing and dicing your data every time you run an experiment – work on a single source of truth. #### AI model training Design datasets with one-click GPU assignment and an integrated data science platform powered by Jupyter notebooks. Filter annotations down to the pixel level, train different inference models and validate dataset quality. ### Let's get started The link below will bring you to our quick start guide, everything you need to know to go create a high quality dataset from video. # Quick start guide In this guide we will go over the key steps needed to create high quality datasets from video. **Step 1 : Set up your account** In order to create your Lodestar account you will have to accept an invitation from an existing project owner or admin. This email invitation will be sent from **** with the subject **"Update Your Account"** and it will contain a link that you can use to input your password and log in to Lodestar for the first time. If you cannot find the email please search for it as it may have been placed in your spam folder. ![Lodestar invitation email](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FvVmoDFO8cwf05lfpnpgF%2FScreenshot%202022-02-16%20at%2023.55.17.png?alt=media\&token=4a362ab8-6e8a-4c98-8dee-87b8143fe7cf) **Step 2 : Create your first project** After logging into lodestar you will land on what we call the project explorer, this is where all your future projects will live. At this time no projects have been created yet so the list is empty. ![Empty project explorer](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FvkYUy0vHjeS955GyO7Y1%2FScreenshot%202022-02-24%20at%2016.19.35.png?alt=media\&token=dd1fe1ad-503a-4690-839b-70f2a8bd0335) You can easily create a new project by clicking the first tile in the project explorer, this will open a pop up where you can enter your project's name and a short description and click the create button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F0xfKEBRL7PRtOeFvV6ES%2FScreenshot%202022-02-24%20at%2016.20.15.png?alt=media\&token=86c7e7cd-41d5-4c2c-8c2b-0715ea837eab) Once you've filled in the name and description of your project a new project will appear in the list. ![Project explorer with one project](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FoIcAkmntXDqQUNL4LdcF%2FScreenshot%202022-02-24%20at%2016.30.32.png?alt=media\&token=dd645e5d-d8e3-41d3-a038-f5a95ba98750) Now that you've created your first project you can click on that tile to open your project's dashboard. **Step 3 : Open the project dashboard** Within the dashboard you can manage your project, we will go into more depth about the different components present here in a later guide but for now here are the basics : \ \ Each project has its own dashboard which can be used to upload media into the annotator, manage the categories you want to label, assign a GPU to the project for AI powered labelling, launch the annotator and review your annotations in the annotation explorer. ![Empty project dashboard](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FxPAe2EL5GGruGIKTzB9U%2FScreenshot%202022-02-24%20at%2016.20.45.png?alt=media\&token=c8cfd3ff-7525-49f8-ba42-167fa91d3560) The dashboard is also the home of the data science tools such as Jupyter and Graphana which are needed for model training and more advanced dataset management. This is a topic for another guide. **Step 4 : Upload your video** From the project dashboard you can click the upload media button in the second panel from the top which will open the project's file management system. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fv0j5BF8f9q7QZtjU3nu7%2FScreenshot%202022-02-17%20at%2000.22.21.png?alt=media\&token=58e1b83f-1dce-45d1-bdb0-2535511140b1) Here you can upload videos that you want to annotate by dragging and dropping them on the folder named "Add to annotator". Once the upload is complete, files in that special folder will get automatically prepared for labeling, this can take up to 30% of the length of the video to complete. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F3aGaf8TekGx3BeS7um6t%2FScreenshot%202022-02-17%20at%2000.25.47.png?alt=media\&token=8c3e22a7-4697-45de-afcf-c24db3bbbdfb) Once the file is ready to annotate the first frame will be displayed in the project dashboard and the statistics will populate on the right hand side. ![Project Dashboard with media uploaded](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FGZXMtL0bNgTNrS36NdoX%2FScreenshot%202022-02-17%20at%2000.03.38.png?alt=media\&token=8aedb19e-e03e-44b4-9f2c-388f4cecab4a) **Step 5 : Accelerate the project** When your media is shown in the project dashboard that means its ready to annotate, you can now accelerate the project by **clicking the toggle** on the dashboard to attach a GPU to the video annotator. This is needed to generate **AI predictions and frame suggestions.** If there is a GPU available in the system then your project will become accelerated within 15 seconds. If not then you will receive a message saying that your request has been queued. You can still launch the annotator but you will have to wait for a GPU to become available before your AI starts to train and generate predictions and suggestions. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FnCUcZEeaEhTzfEzPliPm%2FScreenshot%202022-02-17%20at%2000.26.30.png?alt=media\&token=4a8afdb9-4ad5-46f9-a100-22bbc2bf3fbe) **Step 6 : Launch the video annotator** Now that your data is ready to go you can start annotating. Clicking the golden annotator button will open the project's video annotator. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fj9ahj2DvplMJ2pksTDVO%2FScreenshot%202022-02-24%20at%2016.44.44.png?alt=media\&token=27e8d189-eef8-4fd9-988a-1f48475b9b0e) Now that your media is loaded into the video annotator you can start annotating and turn your video into high quality datasets and models. ![Video annotator with suggestions and predictions already on](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FAE525lO33vwquHYz20Z0%2FScreenshot%202022-02-24%20at%2016.45.30.png?alt=media\&token=8503ea0f-3e9a-4fc7-9b77-d1727c21ec21) **Step 7 : Create a new category** In the video annotator you will find the category menu on the right hand side. which allows you to create new categories for your annotation project. Just click the + in the top right corner and enter the category name. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FRjjFFLLzlZlO0Gf3RqsA%2FScreenshot%202022-02-24%20at%2016.49.15.png?alt=media\&token=bf8147f8-fc74-4565-aad4-95521d8c8bec) Once you've created your categories you'll see that there will be a highlight on one of them, this shows that this category is selected and if you were to start drawing this is the category that would be selected. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FDuat2m26EX7CQEnG2DSi%2FScreenshot%202022-02-17%20at%2000.28.29.png?alt=media\&token=4aa6ddfe-71e6-46b9-8bf3-a7a32e73f7c7) **Step 8 : Label your videos manually** By selecting your category in the right hand menu and dragging and dropping directly on the video you will be able to create annotations.\ \ ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FqRuZjFtUoSRwWBOIJ4DD%2FScreenshot%202022-02-17%20at%2000.52.06.png?alt=media\&token=8b01a80f-da8d-46ba-9120-bd10e2ab9fc5) \ \ You can click on a bounding box to select it and then use the blue corners to modify the box \ If you need to delete a bounding box, select it and press the **'D' key,** pressing it once will turn the box dark and turn it into a background annotation. To remove it completely press the **'D' key** again.
![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fho31Pwp4wE5WYYESqiqO%2FScreenshot%202022-02-17%20at%2000.56.49.png?alt=media\&token=c1f7b512-6e47-4545-9ad6-d4373d76576d) Once every object of interest in the frame has been labeled you have to click the green button to confirm the frame or use the **shortcut 'F'** before moving on to the next frame. You will not be able to annotate further until you confirm to the AI that the full frame has been annotated. ![Green confirm edits button must be pressed when you are done with the frame](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F43tRpSqRazHoSQR2Zqm8%2FScreenshot%202022-02-24%20at%2016.52.37.png?alt=media\&token=68f02ca2-997d-4dfb-bf53-9d298e48eda3) At any time if you would like to see how many annotations you and your team have made you can click on the down arrow next to each category to open the category panel. My annotation count refers to the annotations you have made, while all annotations takes into account all the annotations that have been made by all users in this project for a specific category. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FsJ7t23VHTXRg03bR41DI%2FScreenshot%202022-02-24%20at%2016.55.15.png?alt=media\&token=fbe20543-16d9-4318-9ead-9714e545eeb4) {% hint style="success" %} It takes 20 annotations total for the automatically trained model to turn on and start generating predictions and suggestions. For this manual phase you can use the video controls to navigate through frames. or the 'E' key to move ahead 10 frames at a time. {% endhint %} {% hint style="info" %} To switch videos manually refer to the hint at the bottom of the guide and use the link. {% endhint %} **Step 9 : Label your videos with AI predictions and suggestions** Once you have annotated 20 examples of any category the labelling AI will automatically get trained and start generating its own labels as well as suggested frames that it would like the user to verify. Predictions made by the AI can be distinguished by the colored bar below the label which represents that predictions' confidence level. ![AI predictions with no confidence filtering ](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fssk98Nspdza9xRJN49bo%2FScreenshot%202022-02-17%20at%2000.44.12.png?alt=media\&token=bc78b731-dbc2-4d6c-a1b1-998474dd0d18) Before you start editing a frame you can use the **'C' key** to filter out model generated labels by confidence level. This is useful at the start of a project to quickly remove low quality predictions. ![AI powered predictions with a confidence filter at 80% see bottom right corner](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FZy9BFUMQoY72H63e0iIs%2FScreenshot%202022-02-17%20at%2000.44.32.png?alt=media\&token=c55fb054-d352-4c89-a724-13d7bd6663e0) {% hint style="info" %} If you want to see the list of keyboard shortcuts you can always open the shortcut panel on the left hand side of the video annotator {% endhint %} **AI powered suggestions**\ \ The 7 thumbnails below the video player are suggestions made by the AI. Frames that have been chosen by the AI because they contain valuable information that will increase the model's performance. This intelligent frame selection is known as active learning. Clicking any of the thumbnails will navigate to that frame, suggestions can come from any video, the X in the top right corner can be used to dismiss a suggestion. The golden squares indicate which part of the data set these suggestions are coming from. In this case we see that there are 10 minutes of data represented by the lighter squares. The golden squares are all in the first half of the video data set. The confidence graph in the bottom right corner shows the confidence of the different predictions on screen, you can use the **'C' key** to change the threshold below which predictions are not shown. ![Suggestions are the 7 thumbnails shown below the video controls ](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FaIqLmhTbOja0Z8OI2Yit%2FScreenshot%202022-02-17%20at%2000.54.36.png?alt=media\&token=ea7b0329-a93c-4d10-a518-470c0d75610b) **Step 10 : Invite your collaborators** Now that your project is set up and the labeling AI is generating suggestions and predictions it is time to invite the rest of your team to the project. In the project dashboard there is a panel titled collaborators that you can use to invite team mates to your project using their email. They will be able to access your project's dashboard and create their own projects. Only you the project creator can invite people to your project. ![Collaborators panel](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F6Q4E25oKreXq3XOTQ08O%2FScreenshot%202022-02-17%20at%2001.05.41.png?alt=media\&token=dac3e720-fe29-45b7-a499-905ba112b8f8) {% hint style="info" %} Video annotator links can be used to share specific datasets, images or videos. Pressing P while the annotator is selected will copy the link to your clipboard. `Server.lodestar.ai/annotator#datasetId=8&streamId=6&frameNumber=83` Server should be replaced by your server's name\ FrameNumber can be modified to access a specific frame\ StreamId can be modified to look at another video\ DatasetId can be modified to point to a custom dataset {% endhint %} **Step 11: Review your annotations** Now that you and your teammates are working together on this project you can use the annotation explorer menu item on the left in the project dashboard to review your existing annotations and manage the work of your team members. ![Click the annotation explorer tab on the navigation menu on the left side ](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FrbEPA2O13sKjoKnvoyiw%2FScreenshot%202022-02-24%20at%2017.11.23.png?alt=media\&token=82a63bee-b036-4f86-be64-c29d887bd918) The annotation explorer is the interface for managing your annotations, reviewing them, collaborating with your team members and creating training materials. ![Annotation explorer displaying annotations](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FC6hasuLnl19MmOakjA3K%2FScreenshot%202022-02-24%20at%2017.07.19.png?alt=media\&token=caef9240-5bc0-4ed5-bc1b-1b96a3dcde13) At the top of the annotation explorer you have a set of filters that you can select to narrow down what annotations are displayed, by category or by property of the annotations. You can use the textbox, flagging button and exemplar button to aid you in your review process. All three of these mechanisms are available to the annotators in the details panel on the left, that way they can flag and leave notes on any ambiguous edge cases not covered in the training materials. ![An edgecase of a pool and jacuzzi with a note and flag on the left panel](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fqyb9eLU46iFXASA6RNCY%2FScreenshot%202022-02-24%20at%2017.47.00.png?alt=media\&token=04ac3a51-43c9-4ca8-97a3-f583b583d53c) Using the flagged filter in the annotation explorer I can take a look at all the edge cases that have been signalled by the annotation team as ambiguous and address the specific issues. I can make a positive edge case into an exemplar by clicking the make exemplar button which will add it to the training materials. ![The same edge case of a pool and jacuzzi being displayed in the annotation explorer](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FJYAM7Ik0sqSyzt9eAhT3%2FScreenshot%202022-02-24%20at%2017.50.47.png?alt=media\&token=bb55fb84-8496-4da1-8f16-f8cd294cc65f) Exemplars will be displayed on the project dashboard in the category panel as examples of good ways to annotate specific edge cases. This method enables new annotators to quickly get up to speed on how to annotate complex cases in a consistent way using data from the project itself. Optimizing the reviewer's time as they can evolve the labelling guide over time by simply looking at all the confusing cases and ensure high data quality throughout the project. ![Exemplars demonstrating how to annotate solar panels in different contexts](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FbnxBVkniTp5T8NY7i95h%2FScreenshot%202022-02-24%20at%2017.42.29.png?alt=media\&token=3ba1e4f7-8373-414c-b277-65e58801957e) # How-To Guides Below are quick examples of shortcuts and utilities to get the best out of the Lodestar system This section will cover the areas which contain steps to be followed to perform certain actions like how to upload a video, how to make annotations, how to delete annotations etc. # Project Explorer ### How to see only your Accelerated project **Step 1:** Go to Project Explorer. **Step 2:** In the top right corner, click Accelerated. **Step 3:** This will filter the project list so only accelerated projects are displayed. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FjqybEtx3E8SEbZnEgfnC%2Faccelerated.PNG?alt=media\&token=135dfe1a-e3f5-4884-b842-0ddb781f811f) ### How to see only your Archived projects **Step 1:** Go to the Project Explorer. **Step 2:** In the top right corner, click on Archived. **Step 3:** This will filter the project list so only archived projects are displayed. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fvb96yuVYVAO8VePuvKH0%2Farchive%20folder.PNG?alt=media\&token=e3e32561-24ac-490d-8f13-a871a07bdea2) # Project Dashboard ### How to Pause a Project You can manually pause a project by clicking on toggle. This will release the resources from the project so that you can activate other projects. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Ft6cjAnB7Q0xRd51zVd0H%2Factivation%20off.PNG?alt=media\&token=2d08c8db-3175-444e-955b-d5a0c17a0fe2) ### How to Accelerate a Project You can Accelerate a project by clicking on the toggle. Accelerated projects are actively using a Graphical Processor Unit (GPU) to train a model in real time and generate suggestions and predictions. Once the project is accelerated, the lavel will change from Lauch Accelerator to Launch Accelerated Annotator. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F76s67DoFBBl3QgTzQn9b%2Faccelerated%20full.PNG?alt=media\&token=03452499-16a9-42f2-911a-71a7a89c77f0) ### How to Launch Video Annotator You can launch the video annotator by clicking on the yellow button while the project is activated and acceleration is disabled. However, there is no GPU assigned so you won't get predictions and suggestions. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FL132bU2xcSplZWvi1hom%2Facceleation%20off.PNG?alt=media\&token=2cc9f67e-3281-4a37-8e35-dbeb21921ef3) When the project is accelerated, you can launch the accelerated annotator by clicking on the yellow button. You will get the predictions and suggestions as the GPU is assigned. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FuhAwleDTS6fJtr5dtFrF%2Faccelerated%20full.PNG?alt=media\&token=210c2fb7-a30e-49bf-a99e-d4e294119d4a) ### How to Upload a video to Project In order to view the steps to upload video to project, please refer below link. {% content-ref url="/pages/ZaFlVvQ92n2LeufRN8zZ" %} [Uploading a Video to Project](/project/project-management/uploading-a-video-to-project) {% endcontent-ref %} ### How to Archive a Project In order to view the steps to archive a project, please refer below link. {% content-ref url="/pages/S4vw0qOI5RTzstDtI0bC" %} [Project Archival](/project/project-management/project-archival) {% endcontent-ref %} ### How to Delete a Project In order to view the steps to delete a project, please refer below link. {% content-ref url="/pages/Ao7dIOBPvmZxAaCx2lsQ" %} [Project Deletion](/project/project-management/project-deletion) {% endcontent-ref %} ### How to Rename a category In order to view the steps to rename a category, please refer below link. {% content-ref url="/pages/sJDsmdR6tIJLWNQnNV44" %} [Broken mention](broken://pages/sJDsmdR6tIJLWNQnNV44) {% endcontent-ref %} ### How to Delete a category In order to view the steps to delete a category, please refer below link. {% content-ref url="/pages/r3GdY5QaKxCg1DPiyROW" %} [Broken mention](broken://pages/r3GdY5QaKxCg1DPiyROW) {% endcontent-ref %} ### How to run a Jupyter notebook template In order to view the steps to run Jupyter notebook, please refer below link. {% content-ref url="/pages/CZLTKSyoaZypS1rIlniA" %} [How to run a template](/jupyter-notebooks/jupyter-templates/how-to-run-a-template) {% endcontent-ref %} ### How to change Color of category In order to view the steps to change color of category, please refer below link. {% content-ref url="/pages/I4ulwyJcS3lVFJ9mop9G" %} [Broken mention](broken://pages/I4ulwyJcS3lVFJ9mop9G) {% endcontent-ref %} ### How to change Project Thumbnail In order to view the steps to change project thumbnail, please refer below link. {% content-ref url="/pages/fM5V3bSyyrFiRbu9hTIv" %} [Changing Project Thumbnails](/project/project-management/changing-project-thumbnails) {% endcontent-ref %} ### How to load Multiple videos file In order to view the steps to load multiple videos, please refer below link. {% content-ref url="/pages/xqrmfjdbnSKZ0Jczfohv" %} [Combining Multiple Video files](/jupyter-notebooks/jupyter-templates/combining-multiple-video-files) {% endcontent-ref %} # Annotation Explorer ### How to QA Annotations In order to view the steps to QA annotations, please refer below link. {% content-ref url="/pages/K2S5LFNaU24x9SKVK0w7" %} [Review Annotations](/dataset-management/annotation-explorer/review-annotations) {% endcontent-ref %} ### **How to create Notes** In order to view the steps to create notes, please refer below link. {% content-ref url="/pages/GOR1NQ0B1x5E9VEHv3zL" %} [Creating Notes](/project/project-management/notes/creating-notes) {% endcontent-ref %} ### How to update Notes In order to view the steps to update notes, please refer below link. {% content-ref url="/pages/mdfRjIwUVWGmR1n8OH9r" %} [Updating Notes](/project/project-management/notes/updating-notes) {% endcontent-ref %} ### How to delete Notes In order to view the steps to delete notes, please refer below link. {% content-ref url="/pages/6s7928GdiNbjMG2ZHlB4" %} [Deleting Notes](/project/project-management/notes/deleting-notes) {% endcontent-ref %} ### How to filter Notes In order to view the steps to filter notes, please refer below link. {% content-ref url="/pages/EiLralaWJVXPonxV0q2N" %} [Filtering Notes](/project/project-management/notes/filtering-notes) {% endcontent-ref %} ### How to create Exemplars In order to view the steps to create exemplars, please refer below link. {% content-ref url="/pages/6h18h6pm0OY1OAJ6woJu" %} [Creating Exemplars](/project/project-management/exemplars/creating-exemplars) {% endcontent-ref %} ### How to delete Exemplars In order to view the steps to delete exemplars, please refer below link. {% content-ref url="/pages/AIM5nO1hUYX2dzBixdB8" %} [Deleting Exemplars](/project/project-management/exemplars/deleting-exemplars) {% endcontent-ref %} ### How to filter Exemplars In order to view the steps to filter exemplars, please refer below link. {% content-ref url="/pages/mhD9aHfHVgy1AotTnqyb" %} [Filtering Exemplars](/project/project-management/exemplars/filtering-exemplars) {% endcontent-ref %} ### How to create Flagged Annotations In order to view the steps to flag the annotations, please refer below link. {% content-ref url="/pages/Wg3ZUBJnijF1LFey60HV" %} [Creating Flagged Annotation](/project/project-management/flagged-annotation/creating-flagged-annotation) {% endcontent-ref %} ### How to delete Flagged Annotations In order to view the steps to delete the flagged annotations, please refer below link. {% content-ref url="/pages/2uYU1Sw4HHFNh12UtTVS" %} [Deleting Flagged Annotation](/project/project-management/flagged-annotation/deleting-flagged-annotation) {% endcontent-ref %} ### How to filter Flagged Annotations In order to view the steps to filter the flagged annotations, please refer below link. {% content-ref url="/pages/wV7zKjk9nND2tlwei1rE" %} [Filtering Flagged Annotation](/project/project-management/flagged-annotation/filtering-flagged-annotation) {% endcontent-ref %} ### How to edit the Annotations In order to view the steps to edit the annotations, please refer below link. {% content-ref url="/pages/XbxlCTUvsBbjetphC4lq" %} [Edit the Annotations](/project/project-management/edit-the-annotations) {% endcontent-ref %} ### How to filter Annotations per category In order to view the steps to filter the annotations per category, please refer below link. {% content-ref url="/pages/niHY6ViB6hykC7fnGAg7" %} [Filtering Annotations per Category](/project/project-management/category/filtering-annotations-per-category) {% endcontent-ref %} # Video Annotator ### How to Delete a label In order to view the steps to delete a label, please refer below link. {% content-ref url="/pages/EG7sTdwx4f3gL5bSZDHJ" %} [Deleting a label](/dataset-management/video-annotator/deleting-a-label) {% endcontent-ref %} ### How to Remove AI predictions In order to view the steps to remove AI predictions, please refer below link. {% content-ref url="/pages/ljdfQtndwkjyf0cfjcGg" %} [Removing Predictions](/dataset-management/video-annotator/removing-predictions) {% endcontent-ref %} ### How to find my Project ID/ Data set ID/File ID In order to view the steps to find Project ID/ Data set ID/ File ID, please refer below link. {% content-ref url="/pages/gAIzbgxFlpn4KJSBnIlO" %} [Finding my Project ID/ Data set ID/File ID](/dataset-management/video-annotator/finding-my-project-id-data-set-id-file-id) {% endcontent-ref %} ### How to change Playback speed of the video In order to view the steps to change playback speed of the video, please refer below link. {% content-ref url="/pages/W1IHDA3y07O7GgKX6U0C" %} [Changing Playback speed of the video](/dataset-management/video-annotator/changing-playback-speed-of-the-video) {% endcontent-ref %} ### How to Zoom in/out while annotating In order to view the steps to zoom in/out the frame, please refer below link. {% content-ref url="/pages/4u33Hco7iRpEAfF7OTcn" %} [Zooming In/Out while annotating](/dataset-management/video-annotator/zooming-in-out-while-annotating) {% endcontent-ref %} ### How to navigate between the frames In order to view the steps to navigate between the frames, please refer below link. {% content-ref url="/pages/krPWy7SUbKYUYOG7U0PI" %} [Video controls](/dataset-management/video-annotator/video-controls) {% endcontent-ref %} ### How to check Annotation count per category In order to view the steps to see the annotations per category, please refer below link. {% content-ref url="/pages/o2tm1kNgGZUOkGkggKCh" %} [Annotation count per category](/dataset-management/video-annotator/annotation-count-per-category) {% endcontent-ref %} # Support ### How to reach out to the Lodestar team for support Ask your admin for the support credentials and create a ticket at . Otherwise, please reach out to us by email at . Our team will respond back to you within 24 hours. Thank you! # Shortcuts The following shortcuts can be used to increase your velocity when using the video annotator to create high quality datasets. ### Navigation | Action | Shortcut | | -------------------------------------- | --------------- | | Go to suggested frame | CLICK THUMBNAIL | | Toggle Play/Pause | SPACE | | Go forward ten frames | V | | Go forward one frame | E | | Go back ten frames | W | | Go back one frame | Q | | Zoom in to cursor | SCROLL IN | | Zoom out from cursor | SCROLL OUT | | Zoom in centered | + | | Zoom out centered | - | | Copy video annotator link to clipboard | P | {% hint style="info" %} Video annotator links can be used to share specific datasets, images or videos. `Server.lodestar.ai/annotator#datasetId=8&streamId=6&frameNumber=83` FrameNumber can be modified to access a specific frame\ StreamId can be modified to look at another video\ DatasetId can be modified to point to a custom dataset {% endhint %} ### Annotation | Action | Shortcut | | ------------------------------------------------ | -------- | | Change category to background | D | | Delete background annotation | D | | Change confidence threshold for automated labels | C | | Save annotated frame - confirm edits | S | # Project Creation **Step 1:** After you login, Click on **Create a New Project** tile in the Project Explorer. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FOzZw5Yvkl5VU6NXxj76h%2Fcreate%20new%20project.png?alt=media\&token=450237cb-c7a6-4168-9f4f-a8e77d8f9d06) **Step 2:** A pop up will appear where you can enter your Project's name and a short description and click the **Create** button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F49iwW8Pen79oA0FuI3J3%2Fdesc%20of%20project.PNG?alt=media\&token=dc05a33b-dcb8-4489-a07b-7a29050db4f9) **Step 3:** Once you've filled in the name and description of your project, a new project will appear in the list. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FPxgDJiMnyI1tzFJPOgIU%2Fname%20of%20project.PNG?alt=media\&token=b41df17d-4356-4c40-819b-be5de0e20ffe) **Step 4:** Now that you've created your first project you can click on that tile to open your project's dashboard. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fi4bwOjHPom42hlLN651D%2Fproject%20dash.PNG?alt=media\&token=574df41d-56ab-4094-958c-c94148a5fb40) # Project Management This section covers the project management operations that can be performed on the projects few of which are mentioned below : * Project Dashboard. * Video Uploading. * Changing Project Thumbnails. * Editing Project Name & Description. * Adding/Updating/Deleting/Filtering Notes. * Adding/Updating/Filtering Exemplars. * Adding/Deleting/Filtering Flagged Annotations. * Editing the Annotations. * Adding/Renaming/Deleting Categories. * Filtering Annotations per category. * Changing color of categories. * Managing Project states. # Dashboard While working with projects, there is a lot of information available on the dashboards which is very helpful, user can take a look at the below things on the project dashboard * Summary panel * Video upload panel * Categories panel * Collaborators panel * Data Science Workbench panel : This section contains the tools used by the data scientists like Jupyter, Reference Docs, Grafana, Theia, Hosted App section. # Summary Panel In the Summary panel, you can perform below operations : * Change the Project Thumbnails * Edit the Project Name * Edit the Project Description * View the statistics related to the Project and the Video uploaded for annotation. * **Media Length** : Total length of the video * **Number of Frames** : Total number of frames present in the video where user can perform Annotations. * **User Annotations** : Total number of Annotations performed by the User. * **Cross Validation Accuracy** : This is a percentage that signifies how close the performance of the AI is compared to the human annotator on the set of annotations already created by the human. In order to calculate this, AI will split the full set of annotations into 2 parts, one for training the model and other for testing the model and calculate how the model is performing w\.r.t human. It changes with time as AI is continuously improving itself over a period of time. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FaCJxpaU77kLiIdr66nfn%2Fstatistics.png?alt=media\&token=e5a3fb95-9af4-4fa6-9ff2-39cd24052afe) * You can see additional fields related to project, annotations and categories in Project Dashboard * **Cross validation Accuracy** * **Category Distribution** : A graphical representation is there where you can see which category has more presence in the video. * **Number of Selected Annotations** : Represents the count of Annotations which are Flagged,Notes or Exemplars. * N**umber of Selected Frames** : Represents the count of frames in which Annotations are Flagged, Notes or Exemplars. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FffBBbm6jRcRR8IXDsKgK%2Fimage.png?alt=media\&token=9d0e709e-8bf4-444c-9eff-7a6d14f52ba0) When you click on the **Manage Exemplars** button, Annotation Explorer dashboard will open where you can see existing exemplars, you can add more or modify existing. Below is the link which has detailed information about the Exemplars. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Frc3kVzmDJKPD1jbuMfdi%2Fimage.png?alt=media\&token=f80f1db0-693e-42de-8208-0cfd2554e6d2) {% content-ref url="/pages/iT3BQdzWulr1osxdecUN" %} [Exemplars](/project/project-management/exemplars) {% endcontent-ref %} # Category Panel In categories panel, you can perform below operations : * View Exemplars * Add Categories. * Delete Categories. * Rename Categories. * Change the color of Categories. In order to take a look at the above functions in details, please refer below link : {% content-ref url="/pages/4zCQaFLVB3Mt86hpNshk" %} [Category](/project/project-management/category) {% endcontent-ref %} ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FYYYHx9x6EtxjnCVRdSNY%2Fcategories%20panel.PNG?alt=media\&token=68498ba7-b665-4057-8c9e-22335f5103bb) # Uploading a Video to Project **Step 1:** Click on the Upload Media button in the second panel from the top which will open the project's file management system. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FFHiNNuihYLM7xpz0Rar5%2Fupload%20video.PNG?alt=media\&token=b879f4ed-70ba-437e-8eea-4ca7055e49f9) **Step 2:** Click on the Upload from the top right side, browse the file that you would like to upload. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FzOjo4gg7ZkQViuUJPTeO%2Fupload%20arrow.PNG?alt=media\&token=027e849d-fd67-4ffd-bec2-5dc3e8687d81) **Step 3:** Select an option to upload. Select file if you wish to upload the video directly. Select folder if you wish to upload the folder of videos. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FuFQ3ekfDnQTxgHPXoELo%2Fupload.PNG?alt=media\&token=b3909ad4-acfb-4e0b-b134-790a7761ba62) **Step 4:** Once the upload is complete, Drag and drop the file in the folder “Add to annotator”. Note: If you have selected Folder in previous step, in that case, you will need to drag the video out of the uploaded folder and will need to be dragged to Annotator individually. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FGAOqKFygsHKqov4ETlYd%2Fadd%20to%20anno.PNG?alt=media\&token=46b1d8d4-29ca-49f2-be38-eec7ddc9e20c) **Step 5:** Files in that folder will get automatically prepared for labeling, this can take up to 30% of the length of the video to complete. **Step 6:** Once the file is uploaded successfully and is ready to be annotated, the first frame will be displayed in the project dashboard and the data related to file will populate on the right hand side. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fs2jMNlCU48EczLfcJxpz%2Ffirst.PNG?alt=media\&token=5a63efc9-5885-47d6-ad40-1b74db207893) # Changing Project Thumbnails **Step 1:** Select a project by clicking on it in the project explorer or create a new project. **Step 2:** Upload data into it. **Step 3:** Refresh the project dashboard and you will see that the summary panel is now displaying the first frame of the video that was uploaded. **Step 4:** Once you start making annotations, you will see more frames will appear below the project thumbnail, you can select a new project thumbnail by clicking on one of the thumbnails. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F7y9vhz0vc8NqcwTlbO2y%2Fframes.PNG?alt=media\&token=e7b04f09-4c4e-4f6b-a734-9be16f264308) # Editing Project Name & Description Open the Project Dashboard. Click on the fields as shown below and you can edit the details. It will be updated automatically. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FBcQorE5ChiaHyKlmEoUD%2Fedit%20name.PNG?alt=media\&token=329551ef-e2bd-4402-aeb8-e393470d9a28) # Notes This section will cover the operations that can be performed on Notes : * Creating Notes. * Updating Notes. * Deleting Notes. * Filtering Notes. # Creating Notes You can add the Notes of the categories for better understanding while marking the frames as Exemplars or Flag. Other people can review it and can add to it as per their understanding. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FlM8sVvPFWbn8unV2Owi1%2Fnote.PNG?alt=media\&token=61a33020-5f6e-44ea-a3ff-84d178648db1) # Updating Notes In case you want to update the note, you can edit in the same box and it will be updated automatically. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FymIspufGzWoNAelezOU7%2Fupdate%20note.PNG?alt=media\&token=1da1a38a-a676-4f15-96cc-d99a57fb166a) # Deleting Notes You can delete the notes by deleting the text form the Comment box. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FdkVO2DomGlPthcfBMB0a%2Fdelete%20note.PNG?alt=media\&token=a2cf35a5-cf7f-4c9c-84c7-8e296d9c4d61) # Filtering Notes In the annotation explorer, you can filter the annotations by selecting the checkboxes. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FkT0GTzfnavjSAKiEl2u7%2Ffilter%20by%20icons.PNG?alt=media\&token=0946133c-5475-4b25-92af-3fea39960b75) To filter the annotations with notes, select the **Notes** checkbox. Annotations with notes will be loaded in the thumbnails. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FNc1gdHoxZWmhvPjvmmZI%2Fnotes.PNG?alt=media\&token=c6e3854a-f779-4c9d-841e-f61d6a0941ec) {% hint style="info" %} You can select multiple checkboxes at the same time as well and thumbnails will be loaded as per the selection made. {% endhint %} # Exemplars This section will cover the various operations that can be performed on Exemplars : * Creating the Exemplars. * Deleting Exemplars. * Filtering Exemplars. # Creating Exemplars If you want another user to annotate the category in a particular way, you can make an Exemplar by clicking on the Make Exemplar button which serves as the guide on how to label a given category. You can also add comments for a better understanding of the example which you have created. Select the frame from the thumbnails to which you want to make exemplar then click on **Make Exemplar** button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FCTWCCg8X4QMDKsVXmkZM%2Fmake%20exemplar.PNG?alt=media\&token=14451c96-148b-4fc0-a082-a81ddaf1443f) {% hint style="info" %} After you make Exemplar, star icon will be shown in the top right corner of that specific thumbnail. {% endhint %} ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FgBIr6YSbfl7yDka43AXZ%2Fstar.PNG?alt=media\&token=952831bc-91c5-4fa4-b6ad-b9b41d1a5e6f) # Deleting Exemplars You can also delete the exemplar by clicking on the **Undo Exemplar** button. The exemplar will be removed from the annotation explorer. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Ff3fNy9WDhfiGLSlJp5Or%2Fundo%20exemplar.PNG?alt=media\&token=7fb579c1-8435-458f-ac65-2f89c7b12b64) # Filtering Exemplars In the annotation explorer, you can filter the annotations by selecting the checkboxes. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FkT0GTzfnavjSAKiEl2u7%2Ffilter%20by%20icons.PNG?alt=media\&token=0946133c-5475-4b25-92af-3fea39960b75) To filter the Exemplars, select the **Exemplar** checkbox. Annotations which are made as exemplars will be populated in the thumbnails. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FFW9DwI69MdmpjfrRQcXw%2Fexemplar.PNG?alt=media\&token=f053d6bf-e7cb-45c6-b4e8-6d530ba43bb6) {% hint style="info" %} You can select multiple checkboxes at the same time as well and thumbnails will be loaded as per the selection made. {% endhint %} # Flagged Annotation This section will cover the operations that can be performed on Flagged Annotations: * Creating Flagged Annotations. * Deleting Flagged Annotations. * Filtering Flagged Annotations. # Creating Flagged Annotation If you want to have the other member's suggestion on how to label the category, you can Flag the ambiguous annotations by clicking on the Flag button which can be analyzed by the other person. Select the frame from the thumbnails on which you have confusion then click on **Flag** button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FlHCtK2ObYTggLv549tW9%2Fflag.PNG?alt=media\&token=24460ef8-3b8a-42ac-b60f-bbec8f15afc2) You can also add the description of the confusing category for more clarity. Other people can review it and can add to it as per their understanding. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FvXwgjtzJK1t23zm5B9tf%2Fflag%20comment.PNG?alt=media\&token=79e2939a-932c-4c61-aa01-5da38dc617b9) {% hint style="info" %} After you Flag the annotation along with notes, Flag and note icons will be shown in the top right corner of that specific thumbnail. {% endhint %} ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FrZCLDMxBSL6oNcHjORSY%2Fflag%20sign.PNG?alt=media\&token=13295904-7406-4a43-94d3-4c06e13a8ec0) # Deleting Flagged Annotation You can delete the Flagged annotation by clicking on the Unflag button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FyjECMzqxLrOCwLLgZjtC%2Funflag.PNG?alt=media\&token=648dc44a-6b10-496a-9b85-d7d790ecdfae) # Filtering Flagged Annotation In the annotation explorer, you can filter the annotations by selecting the checkboxes. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FkT0GTzfnavjSAKiEl2u7%2Ffilter%20by%20icons.PNG?alt=media\&token=0946133c-5475-4b25-92af-3fea39960b75) To filter the Flagged annotations, select the **Flagged** checkbox. Annotations which are flagged will be populated in the thumbnails. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FHSfF6fkbQgErL4dkr6ug%2Fflagged.PNG?alt=media\&token=7e7c500a-1b5e-4e9d-b619-096bed236e8b) {% hint style="info" %} You can select multiple checkboxes at the same time as well and thumbnails will be loaded as per the selection made. {% endhint %} # Edit the Annotations You can edit the annotations on the specific frame by clicking on the Edit button next to the Exemplar button. **Step 1:** Click on the **Edit** button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FirNnrepzdIvILeXx86py%2Fedit.PNG?alt=media\&token=5afd0b1e-aa74-4f30-b036-31ad151e2294) **Step 2:** It will open the video annotator and takes you to the specified frame number then you can make the required changes to the annotation. ![Frame number is 179 ](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FPxuQoLTkuqQAzuuBnCT7%2Fspecified%20frame.PNG?alt=media\&token=4fa5a779-4471-4303-a228-c648dcd59c9d) # Category This section will cover the operations that can be performed on Categories: * Creating Category. * Renaming Category. * Deleting Category. * Changing color of Category. * Filtering Annotations per Category. # Adding Category There are 2 places where you can add categories i.e Project Dashboard and Video Annotator. # Video Annotator **Step 1:** In the video annotator, either click the + in the top right corner or +Add your category here. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fa1qgSaapMoW6bP2TWeDY%2Fimage.png?alt=media\&token=2b29e618-29b0-4070-b85c-d531af10e12c) **Step 2:** After you click, you will get the space to enter the Category name. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FcKPB38TOfKqhwPtDtGX9%2Fimage.png?alt=media\&token=57fd6ace-20ed-46ab-b9b2-5b97aa9a3859) **Step 3:** Type the Category name and press enter. Category will be added. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FO5ZYTM2MbcrU41Rj4K2I%2Fimage.png?alt=media\&token=a08eb16e-6df6-4581-9f03-011393f4ccc8) # Project Dashboard **Step 1:** To enter the category click on the + sign again and type the name of another category. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fn8FedbGyYtZl4HSKpKhS%2Fimage.png?alt=media\&token=16a9d947-16da-4eb3-a075-688d1a168964) **Step 2:** After you click, you will get the space to enter the Category name. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FcKPB38TOfKqhwPtDtGX9%2Fimage.png?alt=media\&token=57fd6ace-20ed-46ab-b9b2-5b97aa9a3859) **Step 3:** Type the Category name and press enter. Category will be added. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FO5ZYTM2MbcrU41Rj4K2I%2Fimage.png?alt=media\&token=a08eb16e-6df6-4581-9f03-011393f4ccc8) # Renaming Category **Step 1:** Go to Project dashboard. **Step 2:** Scroll down to Category panel. **Step 3:** On the right corner, move the cursor on the particular category, edit and delete icons will be highlighted. **Step 4:** Use the pencil Icon to rename the category. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F99Wo5Frq2r2QhCiIoP6Y%2Fimage.png?alt=media\&token=3c3450a3-9bcf-48bf-9174-fd3db1acd6ce) # Deleting Category **Step 1:** Go to Project dashboard. **Step 2:** Scroll down to Category panel. **Step 3:** On the right corner, move the cursor on the particular category, edit and delete icons will be highlighted. **Step 4:** Use the trashcan icon to delete an unused category. **Note:** Users can delete the category only if there is no annotation associated with it and no model has been trained on this category. For example*,* you can create a category and immediately delete it. If the model trains on this category then it will display “category in use” and not allow the delete to happen. This is due to the fact that new categories modify the internal structure of the automated model. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F5IgyK9z0SIfWustfjHqZ%2Fimage.png?alt=media\&token=b1ca02dc-bee4-41a5-bba6-15970fec27ea) # Changing color of Category **Step 1:** Go to the project dashboard. **Step 2:** Scroll down to Category panel. **Step 3:** On the right corner, move the cursor on the category, two vertical lines will appear prior to category name. **Step 4:** You can rearrange the position of the categories by clicking and dragging the two vertical lines. Reordering the categories will cause the category colors to reset. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FUZZwRCoVQj5jfxTExylt%2Fimage.png?alt=media\&token=bfe03c68-16a5-4724-a050-2861a30b9204) # Filtering Annotations per Category **Step 1:** Open the Annotation explorer. Click on the Drop down on the right side with default value i.e All Categories. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FIcsFHsCZdRMV9DQY1ZTf%2Fimage.png?alt=media\&token=28b2d7a7-d9b2-4952-8f02-297c74f58676) **Step 2:** You will see all the categories of the project. Select the category for which you want to review all the annotations made. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FxHusnDzIjeitJNmIVQFO%2Fimage.png?alt=media\&token=8fdc938f-fe9b-4267-a691-e7d531a02abe) **Step 3:** Select Restock gaps and scroll down. All the annotations of Restock gaps will be loaded. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Ff0H6qTexs6LUA8WB5P5V%2Fimage.png?alt=media\&token=0edc9f27-e823-4db7-a083-19b90f7d53ee) **Step 4:** If you want to review the details ( File ID, Timestamp, Coordinates) of the specific annotation click on that frame, it will be loaded in the above tile and the respective details will be updated. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fppv751CkWlLhMgCe3SKD%2Fimage.png?alt=media\&token=1c3b913b-ef71-44d2-aba8-01ad060b9166) Note : You can also add the comments to the selected annotation. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FFy4FhAu7TGgTjpV1xoPf%2Fimage.png?alt=media\&token=56f17b89-6782-4065-b21b-01398cc416ed) # Project States This section will cover the various states of the Projects : * Active. * Paused. * Accelerated. * Accelerated but Queued. # Active When a project is created, it will be activated by default. Activated projects can be accelerated by clicking on the acceleration slider. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F0Z5ihvwjshBA4sdGik0m%2Factive.PNG?alt=media\&token=abc78e95-8ca0-43e9-b999-ba62e3363c77) Activated projects consume some resources so you may be asked to turn some projects from activated to paused. # Paused You can manually pause a project by clicking on toggle. This will release the resources from the project so that you can activate other projects. In this stage, you cannot make any changes to the project. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FXnATirD4L72jX5kDccwV%2Factivation%20off.PNG?alt=media\&token=a8367d50-954e-45a1-9ec7-676032971060) # Accelerated Accelerated projects are actively using a Graphical Processor Unit (GPU) to train a model in real time and generate suggestions and predictions. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FXDGLJhqm1FKHxPQKkXHv%2Flaunchh.png?alt=media\&token=b8ba3189-0c43-4d88-bbe9-31daee8ba49e) # Accelerated but queued Clicking the acceleration slider on an active project when there are no free GPUs left will produce the following error message : “No more GPUs request queued”. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FSJoHugIpzCalbmDWCZC9%2Fno%20more%20gpu.PNG?alt=media\&token=b22cdf83-5c8e-4aa1-b6a7-ae944fb17e76) When a GPU becomes available it will be assigned to the next project in the queue.\ \ If you request a GPU and then decide that you don't want it then you can click the accelerator toggle again to get out of the queue. # Project Archival **Step 1:** Pause the selected project using the active toggle. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F2B8WdhS6q2cM9VGQd1pM%2Fpaused.PNG?alt=media\&token=1b33624a-a579-4de0-9568-d5b4f0277342) **Step 2:** Scroll down to the Manage project section, Click on Archive button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FHalX5Fve0YDI2ca94dS0%2Farchive.PNG?alt=media\&token=12e5af1d-88b1-4d92-b833-e786c5606ed6) **Step 3:** Confirm Archive. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FWiD18CDiAUkojQocs1eK%2Farchive%20popup.PNG?alt=media\&token=15c22c1e-fa0f-4f81-a170-9d251f637eec) # Project Deletion **Step 1:** Pause the selected project. **Step 2**: Scroll down to the Manage project section, Click on Archive button. **Step 3**: After you archive the project, delete button will be enabled. **Step 4:** Click on delete project. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FZyqbSJ9Mm0Shya7KXoSB%2Funarchive.PNG?alt=media\&token=23b21083-0781-4017-bd3b-ba5a0b9f50fb) **Step 5:** Confirm delete. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F9BLApztQUaiUGOyeu24x%2Fdelete%20popup.PNG?alt=media\&token=17cb5692-cc3e-4a7f-8ac1-e27845f13f07) # Collaboration Collaboration means you can invite multiple members via their email address to your project to perform/review the annotations along with you. You will be the Administrator of the project and you can invite your team mates by sending an invite to the teammate by entering the email address. These collaborators can be removed if not required in future. # Invite Collaborators In the project Dashboard Collaborators panel, you can invite multiple members via their email address to your project to perform the annotations along with you. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fj8w521DSj7N5uYP20yly%2Fimage.png?alt=media\&token=eeefaf53-b905-411f-afc3-620bae2b4e32) You will be the Administrator. In order to invite your team mates, you need to send an invite to the concerned teammate by entering the email address and then clicking on the Send Invite button as shown below. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FQO4xxlrjUPmDyaVkzLzS%2Fimage.png?alt=media\&token=5af2de9b-ff4a-4a29-bb80-31d1b71233cf) On clicking the send invite button, an Invite will be sent on the mentioned email address and the status will be pending until your teammate accepts the invitation. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FfrqNRoCmOvqmNkcUR17q%2Fimage.png?alt=media\&token=f3da4941-2b4e-4fb5-8b69-0d531de5f5f5) # Accepting invitation to Collaborate In order to accept the invite, you will need to Update the Account using the link under “**Link to account update**” provided in the email. The link to accept the invitation will expire in 1 day. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FkB6Ard5rxfQy9HOE0Ipv%2Fimage.png?alt=media\&token=3ff5afc8-1eef-4ac4-afa8-0380ce7cac79) Then you will need to click on “**Click here to proceed**”. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FDRfR0Korqtf9PsarXwrZ%2Fimage.png?alt=media\&token=68b1b162-c476-47c5-b988-877ab6c2e3c0) Once that is done, the Project invitations page will appear. You will need to select the project name checkbox and click on the **Submit** button. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FYwHmS5SEPb5aDm67ropO%2Fimage.png?alt=media\&token=bf5aa815-a013-489e-856a-5d94127764ac) Once Submit is clicked, you will get confirmation about the Account update. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FrXAPlRa3mtaeoHdZFenu%2Fimage.png?alt=media\&token=26965d61-fbaf-4e91-8bc9-6066fd8c2e05) Once the account is updated, you will need to login to the domain only then your membership status will be updated to Member else it will keep showing as Accepted and you will need to accept the invitation again. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FWApAAUQhVBnkQxzuEcNr%2Fimage.png?alt=media\&token=045b7bba-a27b-4d4e-bdaa-82558ac8ae04) # Resend Invitation to Collaborate You can resend the invitation sent by clicking on the three vertical dots along with the pending status. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FoGUeM0nvDmiVEVhj0Xmt%2Fimage.png?alt=media\&token=6c5cb804-e5e5-41b1-bad2-e392a62088b9) # Cancel Invitation to Collaborate You can cancel the invitation sent by clicking on the three vertical dots along with the pending status. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F3BS8etncyL9ovnDFtsmg%2Fcancel.png?alt=media\&token=f9413998-155f-48d6-a4b8-7259b158dcc5) # Remove Collaborators You can remove your team mates by clicking on the three vertical dots next to the Member and then the remove option as shown below. Once this is done, your team mate will no longer be able to access the Project and will be removed from the collaborators list. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F1VLVRoF4ijlGgzo4OKmA%2Fremove.PNG?alt=media\&token=de2f8d41-5b3a-4815-a11e-3746e4076ba0) # Video Annotator # Confidence filtering For every prediction made by the AI there will be a label that has the category name on it and below that label there will be a colored line that describes the confidence of the AI. Red means low confidence, yellow means medium confidence, green means high confidence. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FXzy7DFyyNodFfs1HQKXf%2Fimage.png?alt=media\&token=831c62ff-f156-4fc9-9cb6-2e416cc75cd7) **Confidence Graph :** It shows the confidence of the AI's predictions in the 6 adjacent frames, this is useful to quickly find low confidence predictions that are confusing the AI and fix them. \ \ In the very early stages of annotation you may find the system predictions are noisy because the model is still confused. The best thing to do is to use confidence filtering to quickly clear the predictions and keep only the highest confidence ones. \ \ **Confidence threshold :** You can use the 'C' key to set the threshold level for confidence and all the predictions below that threshold will be removed once you start editing or confirm the frame. * All ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FRfuV4SMF9hx5t1gkqcTJ%2Fall%20prediction.PNG?alt=media\&token=c0c9b2ce-246c-4ca1-b635-001017f6fa1b) * \>99% ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FmU1PsrdaVTAPQ9FUEJHE%2Fall%20c.PNG?alt=media\&token=ebd6e857-995f-4d04-9427-d568b0f5546c) * \>90% ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FmUbFuSYaOjWkeqtynugK%2Fc%2090.PNG?alt=media\&token=cc2bfd50-b3b1-41d4-9b4d-d164b0efa4bf) * \>80% ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FcUxA8K5DWCBuvAc7Szve%2Fc%2080.PNG?alt=media\&token=bb0d064c-34d0-4d6e-8ca9-c706fef06e69) * \>70% ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FqgNU2YGf0335nyP03TpB%2Fc%2070.PNG?alt=media\&token=35a12651-8486-440e-ac01-74f171f45c07) * \>60% ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FkFqnCIyhKyDiffIZrLTK%2Fc%2060.PNG?alt=media\&token=450c6f70-7e2a-4039-b2d9-78437df788d4) # Modes while annotating During the process of annotation the annotator will switch between 3 modes of navigation. These modes are : Sample, Nearest and Suggestion # Sample mode If you use the annotator without a GPU or you have less than 20 labels confirmed, the annotator will be in sample mode. What this means is the thumbnails will be picked from your first video at regular intervals, this is called uniform sampling. For example if your 1st video was 7 minutes long each thumbnail would be 1 minute apart. \ \ In sample mode if you wish to navigate to another file you can use the Lodestar Link method which is described in the shortcuts guide. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fu3WVrYluy6GUIhNFOWov%2Fsample.PNG?alt=media\&token=8f8f8af1-c768-4ea2-a41c-f467525b0403) # Suggestion mode If you accelerate the video annotator and confirm 20+ labels the AI model will turn on and start generating predictions and suggestions. You will see that the mode switches to suggestions, the little squares will turn on to indicate which part of your data the suggestions are pointing to and if you navigate to a suggestion you will see predictions. \ \ Predictions are the automatic bounding boxes that have a confidence bar under the label. The model keeps learning as you provide more labels and predictions will keep getting better over time. Suggestions are the thumbnails with crosses in the right corner, these are the frames that the AI is most confused about, labelling these frames will increase the performance of the object localizer faster than other frames. You can click the cross to dismiss a suggestion that you don't want to label. It takes the model some time to generate good suggestions as it has to first scan through the video dataset and score the frames. The suggestions you get in the first few minutes will not be as good as suggestions you get once the AI has had more time to scan through the data. Speed of scanning depends on your plan but lies between 10-50FPS. If you de-accelerate a project the model will turn off and you will lose the pre-computed suggestions. However the model training will not be impacted as the model automatically makes checkpoints. It will take some time for suggestions to get to a high quality after a reset of the AI. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FcXoyfXH9u4nLj7iUfuPf%2Fsuggestion.png?alt=media\&token=d1fb4f56-732b-4aaa-a724-df7b5b4d92a7) # Nearest mode If you click on a suggested frame or a sampled frame, the video annotator will load that frame and the mode will change to Nearest mode. Nearest will display 3 frames before and 3 frames after the frame you've selected. \ \ You can use the icons next to the play button to go forward or backwards 1-10 frames. You can also use the arrow keys. This mode allows you to navigate very precisely through your video and find the best frames to annotate. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FU3zKMgdLAo1ojCMbsoN0%2Fnearest.PNG?alt=media\&token=5538743a-b8a8-4f50-a9d2-506b33b79eb2) # Video controls In order to move to next frame or go back to previous one, you can use the icons below the video player. The play pause button will toggle playback. The other buttons will make you move forward or backwards 1-10 frames. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F8yOTco3Ser9sdnIGJfsg%2Ffrwd%20frame.PNG?alt=media\&token=5c968e8e-7965-468b-94dc-9b27f9e8aa6c) # Zooming In/Out while annotating Step 1: Open the Video annotator. Click on the Zoom option on the left side. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F9EZA0hAik1mG18J7OZAh%2Fzooom.PNG?alt=media\&token=19a9cdc3-9a1d-4eb1-93f3-8bae4c1690cf) Step 2: Zoom display will open. You can click on the Magnifying glass with Plus and minus sign next to Reset in order to zoom in and zoom out respectively. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FyxTIlfWVzErZkqgvfa7F%2Fzoom.PNG?alt=media\&token=3a79cd3a-ff7c-4ee8-aa90-fdd896180261) {% hint style="info" %} You can also scroll the wheel of your mouse up to zoom in or down to zoom out. {% endhint %} # Annotation count per category Once you open the Video Annotator, in the right side you can see the number of annotations you have made as per the different categories. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FstqP3sa3SWPVp0woPR3Q%2Fannotation%20count.PNG?alt=media\&token=7ec494f0-b656-4e28-8a49-b9902d721b2e) {% hint style="info" %} Here, My annotation count is the count of annotations done by you and the All annotations refers to the total annotations made in this project either by the team which includes you and your team. {% endhint %} # Changing Playback speed of the video **Step 1:** Go to the video annotator. **Step 2:** Click on the 1x in the bottom right corner of the video player this will open a dropdown with multiple options. **Step 3:** Select the desired speed of video playback. The higher the number the faster the video will play back. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fg9V90pOPQXxPjuN4X8Po%2Fplayback.PNG?alt=media\&token=cd7860bd-ea38-45c2-834a-c01bdd309f6f) # Finding my Project ID/ Data set ID/File ID **Project ID** can be found on the project URL: [https://xxx.app.lodestar.ai/project/**4**/dashboard](https://docs.lodestar.ai/dataset-management/video-annotator/www.lodestar.ai). \ **Dataset ID** can be found while in the annotator URL: [https://video-annotator.xxx.app.lodestar.ai/annotator#datasetId=**4**](https://docs.lodestar.ai/dataset-management/video-annotator/www.lodestar.ai)**.** \ **File ID** can be found under annotator screen in the details section on the left. ![In the details panel you can see that the first line contains the File ID](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FwZTNm9BKfa9kfw2FUBtx%2Ffile_id.PNG?alt=media\&token=174e4552-a767-4828-b2e7-1893b12d314c) # Removing Predictions In the very early stages of annotation you may find the system predictions are not speeding out your work because the model is still confused. **Step 1:** Remove all predictions Press the 'C' shortcut before making any changes to filter the AI predictions by confidence. The first press of the 'C' key will remove all predictions. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FIuH8Yw7M7ODsPH70CDh3%2Fall%20c.PNG?alt=media\&token=cd0d1bb1-33d1-4f3e-8df8-2a559f2ee95f) **Step 2**: Filter by confidence Additional presses of the 'C' key will display predictions by confidence, starting with predictions above 90%, 80%, 70% etc. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FmUbFuSYaOjWkeqtynugK%2Fc%2090.PNG?alt=media\&token=cc2bfd50-b3b1-41d4-9b4d-d164b0efa4bf) ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FcUxA8K5DWCBuvAc7Szve%2Fc%2080.PNG?alt=media\&token=bb0d064c-34d0-4d6e-8ca9-c706fef06e69) **Step 3:** Remove individual annotations If you need to delete individual annotations you can select them and press the 'D' key twice to remove them like you would manual annotations. ### # Deleting a label **Step 1:** Select a label Click on the label that you want to delete, light blue corners will appear around the selected label. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FmZFHLY7gsPoEBBdS0P1g%2Fblue_color.PNG?alt=media\&token=da02140e-6b2e-4008-87ac-fc4fe3333f39) **Step 2:** Delete the label Press the 'D' key twice, this will turn the label dark at first and then remove it completely. Dark labels are used to signal to the AI that this region is specifically NOT an object of interest. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FoPAhal8rI88SrA1aBmHA%2Fbackground.PNG?alt=media\&token=729d005d-107c-4790-93d0-df39fbb09c91) # Adding Notes You can add the notes with the selected annotation in the video annotator by clicking on the text box on the left side under **Notes**. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F6ddL5b4IRazYTaS6Vkdv%2Fblank%20note.PNG?alt=media\&token=725a9e3c-903d-44bd-b510-0ebd85b39168) **Step 1:** Select an annotation, the **Notes** section will be highlighted. Then, add the **Notes** in the text box. You can also flag the same for review. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FbOClxvcBWMDzTKRtUaL9%2FNotes%20default.PNG?alt=media\&token=e73dfbf0-23ec-4017-b406-63e482bb9589) **Step 2:** After you add the notes, click on the **Confirm Edits** button in order to save the notes. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FCMJ1mD7GXvJQzp1rqmHs%2Fexample%20notes.PNG?alt=media\&token=d788680f-caa0-47f5-9fd4-151eb1543fe5) {% hint style="info" %} After you confirm the edits, the notes will be updated in the Annotation Explorer under Notes. {% endhint %} ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F0rw80FqdsCcz33LCeltt%2Fnotes%20in%20AE.PNG?alt=media\&token=8e986205-896a-4e29-8abf-427c48625325) # Flagging for Review You can Flag the selected annotation for review in the video annotator by clicking on the toggle button on the left side. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FFMa7spkwMxHMEUnZsELc%2Fflag%20default.PNG?alt=media\&token=250fe5d2-f117-4fb1-9334-d199c621d3fe) **Step 1:** Select an annotation, then click on the **Flag for review** toggle. You can also add notes with the same. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FugkUIMJS8zTUzCccQukR%2Fonly%20flag.PNG?alt=media\&token=9b674233-0b24-4908-8ee4-31d898943785) **Step 2:** Click on the **Confirm Edits** button after you flag the annotation. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FDS1U0M234UMvQGHOWl6C%2Fflag%20example.PNG?alt=media\&token=6a016134-3703-4db2-a213-1915be6ee0ed) {% hint style="info" %} After you confirm the edits, the flagged annotation will be updated in the Annotation Explorer under Flagged. {% endhint %} ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F9got5IIzmJzfa0KucMyw%2Fflag%20in%20AE.PNG?alt=media\&token=cf62ae0d-3f36-410b-99f8-ca67c0c813ac) # Annotation Explorer # Review Annotations **Step 1: Open the project dashboard**\ Click on your project in the list and you will open up the project dashboard.\ \ **Step** **2 : Open the annotation explorer**\ On the left column in the project dashboard you will see a menu item called annotation explorer, click this menu item to open the explorer and view your annotations. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FaLWKZOOD0WaIzyGcquY6%2Fannotation_explorer.PNG?alt=media\&token=17b00eb1-5f8c-4827-9d6b-8500fdf1510c) **Step 3: Identify issues** \ Look through the annotations using the left and right arrows in the bottom right corner to change pages and click thumbnails to enlarge them. You can write notes or add flags to annotations using the details panel in the video annotator to bring complex annotations to the front of the annotation explorer so they are easier to review. **Step 4: Make the needed modifications** \ Once you find a label that required modification you can go directly to that frame by clicking the yellow edit button. **Step 5:** **Add edge cases to the training materials** \ If you find complex examples that your annotators are having trouble with during your review you can add those to the training materials by clicking the "make exemplar" button. This will display the thumbnail with the correct annotation on the category panel. You can also add a note in the annotation explorer to explain why an edge case should be labelled in a certain way. \
# Notes {% content-ref url="/pages/tztc53ek1isz0ne3p8Ec" %} [Notes](/project/project-management/notes) {% endcontent-ref %} # Exemplars {% content-ref url="/pages/iT3BQdzWulr1osxdecUN" %} [Exemplars](/project/project-management/exemplars) {% endcontent-ref %} # Flagged Annotations {% content-ref url="/pages/AUfkaTSUJ0tSBpcmDiqC" %} [Flagged Annotation](/project/project-management/flagged-annotation) {% endcontent-ref %} # Jupyter templates In this section we will be providing helpful coding templates that you can use to perform more complex actions using the Lodestar API. \ \ You can also create your own jupyter templates based on ours or using the API documentation to interact with the database and other services in custom ways.\ \ You can use jupyter to run experiments, train models, develop chains of models or complex workflows. # How to run a template **Step 1:** Open the project that you would like to work on. **Step 2:** Scroll down to Data Science Workbench.\ \ **Step 3(Optional):** Toggle the Accelerate Jupyter to assign a GPU to Jupyter. This toggle is optional for regular scripts, it is required for the Jupyter notebooks that involve using models. The tutorial notebooks which require GPUs will state that requirement in the first cell of the notebook. The toggle will be in progress until the GPU is successfully assigned to Jupyter, if there are no available GPUs the request will become queued and catch the next GPU that is freed up. ![How to accelerate Jupyter if you need to use models ](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FQdyeXxexCISggUbZzqnm%2Fimage.png?alt=media\&token=6f99042a-a7bb-4973-bacd-617b5071cbef) ![After accelerating Jupyter you will see an in progess state until the GPU is assigned](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FM8nDMHmLU3ERAzOdRCkp%2Fimage.png?alt=media\&token=2c5e323a-2702-4dbc-9a5c-ccdf396b3eaf) **Step 4:** Click on the Jupyter logo, this will open the Jupyter server for this project in a new tab. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FfyoK8G4vNH0kmZyzzayP%2Fimage.png?alt=media\&token=1a144e52-76e8-4d49-a955-83fdff7b6390) **Step 5:** Open the tutorial folder and select a template. **Step 6:** Modify the parameters in the first cell to suit your needs. **Step 7:** Wait until the circle in the top right corner says Kernel is ready. **Step 8:** Click the play button to execute the selected cell. **Step 9:** Observe the output. **Step 10:** Execute all the cells that you are interested in. ### # Combining Multiple Video files If you would like to use the scrub bar across all your video files you can run our jupyter template to combine your videos. **Step 1:** Open the Project Dashboard \ Click on the project card of the project you want to work with\ \ **Step 2:** Open the file browser\ Click upload media, this will open the file management system in a new tab. **Step 3:** Upload your folder of videos \ Click on the upload button in the top right corne of the filebrowser and upload your folder of videos. **Step 3:** Combine your videos \ Go back to the project dashboard using the browser tabs, scroll down to the panel named 'DS Workbench' and click on the Jupyter card. This will open the jupyter server in a new tab. \ \ ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F5lrlIU5q1ayj2k929uBY%2Fimage.png?alt=media\&token=75ff6281-e13e-4d78-9af0-20814b3af237) Open the template named : Concatenate\_videos.ipynb Enter the name of your folder videos in the following parameter : **`input_folder_path`**` ``=`` ``'/workspace/raw_data/(your folder's name here)'` Use the play button to run the different cells in the notebook. Once the notebook is done running, open the file browser where you uploaded your data. You will find a new file called **merge\_vid**. drag that video to **add\_to\_annotator** folder to ingest it and make it ready for annotation. # Support In this section you will get a step by step guide to using our Zendesk Customer Success Portal to ask questions and submit any issues you would like our Customer Success team to help you with. \
# How to contact Customer Success Team Log in into the Lodestar Zendesk portal by navigating to .\ \ Sign In using the email and password provided by your account admin, each organization has a set of credentials provided at the time of engagement that is used to manage support requests. \ \ If you do not have access to your account credentials but have need for support send us an email at : include your organization's name and we will get back to you within 24h. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FXSOYpEHebJ9U4ri6DuNg%2Fzendesk%20login.PNG?alt=media\&token=1b52e52d-8333-42ad-a2b8-d1f4bf556d0d) # How to create a Support Ticket Once you login to , you will be able to see your organization's existing tickets and submit new tickets or questions. To create a new ticket, click on **Submit a request** in the top right corner. ![Here we can see some helpful materials and the button to create new tickets in the top right corner](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FpNnBrZK0dc3jQi4AIwTc%2Fsubmitt.png?alt=media\&token=529f38c3-066f-4948-a790-e9a666ddd80d) Clicking this button will open the request creation form which gives you two options, creating a Support Request or asking a question. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FGaVxviv4cUHBzRA0acme%2Fselect.png?alt=media\&token=555f2cd8-ddff-41b5-ae8e-88d6f2760cd4) Once you've selected create a support request a form will open with the following fields : * **Subject :** A short description of the issue. * **Issue Description :** A more detailed description of the issue. * **Priority :** How urgent this issue is, typos can wait, blocking issues cannot. * **Operating System :** The OS your are using i.e. Mac, Windows. * **Browser:** The Browser you are using i.e. Chrome or Firefox. * **URL of the page where the issue occurred :** The instance URL in where the issue was found. * **Steps to reproduce the issue :** Please help us understand the steps which can be used to replicate the issue, this is key in identifying the root cause and fixing issues quickly. * **Expected results :** What you were expecting to happen after performing the steps. * **Observed results :** What actually happened after performing the steps. * **Attachments :** Please upload relevant screenshots and logs for quicker resolution of the issue. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F0FC4qrkov0YLBMikJC8v%2Fsupport%201.PNG?alt=media\&token=4bfd2c52-d50b-4861-81e0-a147f6fbb987) ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2Fw8S988BToc2vPBE1zNEt%2Fsupport%202.PNG?alt=media\&token=6d824860-ccee-45ca-b66a-1a93f91925ed) ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FKjcoGFQiA5ZE164NHowr%2Fsupport%203.PNG?alt=media\&token=c13c9a5c-67f9-4a64-a3b5-14d08307cde4) # How to submit a question Once you login to , you can see all the existing Support Requests as well as raise new Support Request. In order to raise a new Support Request for questions, click on **Submit a request** link in the top right. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FpNnBrZK0dc3jQi4AIwTc%2Fsubmitt.png?alt=media\&token=529f38c3-066f-4948-a790-e9a666ddd80d) A request form will open which will have two options. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FGaVxviv4cUHBzRA0acme%2Fselect.png?alt=media\&token=555f2cd8-ddff-41b5-ae8e-88d6f2760cd4) Please select **Ask a Query**, this will open a form with the following fields : * **Subject :** A short description of your question. * **Issue description :** Your full question. * **Priority :** How urgent your question is. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FXFOMyp0ET9x1yMujsTkJ%2Fquery%201.PNG?alt=media\&token=a9dcf2cc-c286-452f-81a0-a9e3bb740727) ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FRhWjVT8NIDkcsdiKJfNZ%2Fquery%202.PNG?alt=media\&token=1a43daf4-7a18-4579-bfff-d307c531b6fb) # How to view existing Support Requests and Questions In order to see all the Support Requests you have raised, click on your name on the top right side and select **Requests**. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2F6roKgF4FK0RKBkpT7IjN%2Frequest.png?alt=media\&token=00517ac0-188f-4347-ac4e-4f43b435efaa) All the Support Requests will appear here as shown below. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FSA23Kw04p4FWIGtMW8rN%2Fall.PNG?alt=media\&token=cf5da6c4-98c3-4b1e-9830-785c0f9d7b69) On the right side, you have a drop down menu from where you can filter the requests as per their status. You can also search for a particular request by typing in the **Search requests** box. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FRysnXc82Sz4lzJqf9jzB%2Fsearch.png?alt=media\&token=114baaf8-e2b9-495d-b089-89ba658bc872) # How to close a solved Support Request If your request has been resolved, you can also mark the request as solved by clicking on the **Mark as solved** button. The status will be updated to closed. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FrDEgKlse9YuL1JA3R9g7%2Fclose.png?alt=media\&token=dfcde2ca-2bce-4c87-aa0a-078427b03b2e) # How to add information to the Support Request? In order to respond back to the team, you can add more information to the request that the customer success team may need for providing better resolution by clicking on the **Add to conversation** box. ![](https://463627914-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FinJu6LM7OC1ljc7Bm3uk%2Fuploads%2FeXWplKaEnOCTYiEG7O9O%2Fedit.PNG?alt=media\&token=62a0c51f-d310-41f6-a386-acda9ac5aa57) # FAQ Here are a list of frequently asked questions **Q: What should I be annotating?** A: Anything that you could train a human to recognize in under an hour, you can use Lodestar Navigator to recognize automatically. Take a look at our quick start guide to get some more information on how to label video using Lodestar. **Q: Should I include “this” in the bounding box?** A: The way you place bounding boxes will inform the AI how it should place its bounding boxes. As long as you decide what you’re going to include and annotate consistently , the AI will be able to make the same bounding boxes. \ Depending on what your downstream application is you may make different choices about what gets included. For example, maybe it's important that the AI can recognize the position of the full object even if they are in part hidden, if that’s the case then you should label the full object even if it is in part hidden. If you would rather your AI identify only the objects that are fully present on the screen then you should be annotating only the full objects. **Q: The AI is making a lot of predictions on every frame, what’s going on?** A: This is normal at the start of a project when the AI is still figuring out what it should be detecting. You can use the 'C' key before you start editing a frame to delete all machine annotations below a certain percentage confidence; once you start editing the frame you won't be able to change the confidence threshold. You can hit C multiple times to see different confidence thresholds. If this issue does not go away maybe the category you are trying to recognize is not clear enough for the AI to detect yet and it will require more labels for it to become competent with it. **Q: I added a new category but I am seeing predictions that are not taking that category into account, why is that?** A: The AI model is constantly being trained and learning new things, however the predictions that you see on your data could be slightly outdated. For example, if you train the model to recognize only strawberries, this first model that detects strawberries will go through your data and make predictions. If you then add a new category for blueberries this will create a new AI model that can detect both blueberries and strawberries, but it has not had the time to go and make predictions. So if you navigate to a new frame right away you will see predictions made by the older model that did not know that it is supposed to be detecting blueberries. Leave the project in an accelerated state for some time for the newer model to make its predictions. **Q: I corrected a prediction made by the labeling AI but it is still predicting that object incorrectly, why is that?** A : The predictions are staying on the data after the labeling AI has made them even if the labeling AI has been updated since then. So there will be predictions that you see from older models even if you have since then trained the newest model on that exact object. **Q: What is cross validation accuracy?** A: The percentage you see in the project summary is called the Cross Validation Accuracy, it's a test of how good the labeled dataset is at training models. We train a model on one subset of the data and then use it to detect objects in the rest of the data. 100% would mean that the model trained on a part of the dataset makes perfect bounding boxes on every single object and does not miss any objects. CV calculations start at 100 annotations including 20 in each category. After the 100th annotation, allow the AI about 1-3 hours to calculate the accuracy; this will depend a lot on the system and the amount of data. **Q: Why is my Cross Validation Accuracy going down?** A: Cross Validation Accuracy is a test of how good the localization model is. We automatically train the model on your labelled data and use new data coming in to test the model. 100% would mean that the model trained on a part of the dataset makes perfect bounding boxes on every single object and does not miss any objects. \ The reason for the accuracy of a dataset to go down is a sign that the problem has become more complicated, more difficult examples have been introduced but not enough to ensure that a model trained on part of the data can detect all of these new examples. Or perhaps the quality of labeled data is not very high. Identifying objects in two different videos taken with two different cameras for example is a more complicated problem than identifying the same type of object as seen by only one type of camera in only one type of light. **Q: Can I upload (images/maps/X-rays/satellite images) into my project?** A: We provide a jupyter template for converting images into the right format so that you can upload images in your project. We do not currently support X-ray data or map data natively but if you can turn it into a video then our video annotator can be used to annotate it. For satellite images we have used sliding windows in the past to turn one large image into a short video. We plan to expand the different types of data that we support in the future. **Q: How can I see the annotations that I’ve made?** A : If you click on a project you will see a menu option on the left that says annotation explorer, you can open the annotation explorer to see your annotations. You can also use Jupyter notebooks to access your annotations programmatically through the data science workbench located in the project dashboard. **Q: How can I see the videos that I’ve uploaded?** A : The filebrowser automatically creates a folder named "uploaded" once your first video is fully ingested into the project. This folder contains receipts of all the files that have been added into the project. \ Suggestions will appear from all of your videos to guide you to the highest value data to train your AI to recognize the categories you’re interested in detecting. Once you’ve followed a suggestion you can navigate within the original video file.\ If you want to navigate between files manually you can look at the shortcuts or quick start
**Q : After I upload my videos they immediately disappear, I can't get them to stay in the file browser, why is that?** A: This is normal, when you add a video to the annotator it gets processed and then it’s removed from that folder. There will be a new folder named "uploaded" which will hold receipts of all previous uploads into this project.\ Suggestions will appear from all of your videos to guide you to the highest value data to train your AI to recognize the categories you’re interested in detecting. If you want to see your videos in a given project or navigate to a specific video see the quick start guide for the steps to follow. **Q: Can I use Lodestar Navigator to make something other than bounding boxes? Polygons? Markers? Semantic segmentation?**\ \ A: As of today Lodestar only uses bounding boxes; it is the fastest way to get a good amount of data and get started on an AI project. We are planning to add segmentation to our product at a future date. If you have a use case that you believe requires some other tools you can contact our product team and we can keep you updated as we release new annotation modalities. ().