Image and Video Analysis in Sitecore Content Hub

Sitecore Content Hub provides Image and Video Analysis features to automatically generate or extract the tags, description, color, metadata, etc. details. Sitecore Content Hub uses the Microsoft Azure OpenAI Service.

Sitecore Content Hub supports the following asset analysis features that you can use to fulfil your specific requirements:

• Image analysis - automatically generates tags, descriptions, and color data for image assets to make it easier to search for and find images.
• Video AI analysis - automatically extracts metadata from your video assets using the Microsoft Azure Media Services Video Indexer.

In this blog post, I will explain the implementation process of the Image and Video AI analysis feature in your application.

Step 1: Go to the Manage > Taxonomy

Step 2: Find and select M.AssetType Taxonomy and add a new Taxonomy named “Image Analysis”.

Step 3: To activate the Image Analysis feature, confirm that the Trigger Vision radio button is selected.

Step 4: If you require access to Video Analysis tagging, complete steps 1 and 2, then verify that the Trigger Video AI feature radio button is enabled.

Step 5: Navigate to the Assets page, open any asset, and select the Overview section. In the Type field, choose the Image Analysis taxonomy and click the Save button.

Step 6: Once you save your assets, Azure AI services will analyze them and display the results in the Image Analysis section on the Asset Details page.

Step 7: To enable the additional Analysis feature, go to Manage > Media Processing and select Vision. Image analysis supports Images and Vectors, while Video analysis uses video flow.

Step 8: Click on any of the flows. For example, select "Images." Then, access "Analysis (Extract Vision Data)" and, in the Extract Vision Data window, update the analysis output using the feature option.

Happy Sitecoreing 😊