Adding and scanning your website in OneTrust Cookie Consent is the first step in organizing and owning website content for ease of compliance. This is done by scanning and identifying first- and third-party cookies, tags, trackers, pixels, beacons and more.
When a new website is added to the application to be scanned, a record is created for the domain and the scan. The scan will remain in the Pending status while records are being created and until the scanner starts.
The scanner, a virtual machine, which runs on a Mozilla Firefox browser, will pick up a message from the queue that a scan has been submitted and begins the scanning process. The scanner will identify the robots exclusion standard or robots.txt
.
Robots.txt
communicates which areas of the site are not available for scanning. This allows the scanner to scan by finding the sitemap for the website. From this point, the scanner acts like a user clicking from page to page within the website and records the cookies that are found on page load.
The scanner will only scan pages that are within the domain that you have entered. For example, if I was scanning onetrust.com and there is link within onetrust.com to zentoso.com, zentoso.com pages would not be scanned. Subdomains will be included in the scan if scanned from the root domain. For example, if you scan www.onetrust.com, only that subdomain will be scanned. If you scan onetrust.com, all subdomains will be included in the scan.
Caution
If your scanned domain does not align with the domain where the script is integrated, consent will not be correctly captured and the banner will reappear every time you load the page.
The scanner treats any URL starting with www.
as a subdomain.
If you scan www.onetrust.com, the OneTrust cookies will only write to this subdomain with base script functionality.
If you scan from onetrust.com, the OneTrust cookies will write to www.onetrust.com, cookies.onetrust.com, consent.onetrust.com, and so on.
For more information, see OneTrust Cookies.
Any cookies that are dropped on a user action and not page load, for example, a form submission other than login or add to cart action, will not be recorded in the scan results.
While the scanner will attempt to reach all pages it can, scanning every page in your site is not necessary. Scanning the majority of the pages will record the cookies and allow you to perform the necessary blocking activities efficiently.
If there is a particular page that you would like to include in the scan, or scan with priority, add it to the target pages in the scan configuration. Detailed instructions included below. You can also enter your sitemap directly in the scanner configuration. Details instructions included below. If you put a page limit in the scan configuration the scanner will only scan up to the limit of pages.
The scanner can reach behind the login form. With the entered credentials and form details, the scanner matches the form on the site and replicates submitting the credentials entered from the application.
The scanner will attempt to reach the login URL first. The scanner login can redirect to a different domain to reach a login form. The login URL and re-direct domain both will need to be entered in the login configuration.
When the scanning activity has completed, the status changes to Processing Data.
During the data processing activity, the scan data will be migrated to your tenant and categorized based on the OneTrust Cookie database Cookiepedia.
Once the data processing activity is complete, the scan will move into a Completed status.
-
Pending
Your scan has been submitted and the proper tasks are being created for the scan to begin.
-
Scanning
The scanner is now scanning the domain that you have entered to be scanned. The scanner acts like a user clicking from page to page. During this process the cookies dropped on each page load will be recorded.
Note
While it is normal for scans to take multiple days, if your scan is taking too long time to complete you can use the menu to retrieve additional scan metadata. This will help support resolve the issue.
-
Processing Data
The data collected by the scanner is being processed and polished from our scanner database to your tenant database. During this process the cookies recorded are compared to our Cookiepedia data base for categorization. If a prior categorization is not found, the cookie will be categorized in the "Unknown" category.
Note
If you attempt to reprocess data that is still in Processing Data, you will receive a notification. Please allow more time for the reprocess to be completed.
-
Completed
The scan has completed when in this state, you can click into the domain and view the scan results.
-
Failed Login
Authentication of the scanner failed. Check your login credentials.
-
Scan Error
This status most likely means that the scan has completed, but there was an issue migrating the data. Open the menu and select Re-process. Allow the scanner at least 2 hours to re-process the scan results.
To add a website to the scanner
On the menu, select . The Websites screen appears.
Click the Add Website button. The Scan Website screen appears.
Complete the fields. For more information, see Add Website Screen Reference.
-
Click the Scan and Configure button.
Note
Click the Scan Only button to scan your website without configuring a container.
-
Select an Experience Kit (geolocation rule group) to which you want to assign the website.
For information on configuring custom Experience Kits, see To configure a custom Experience Kit.
-
Click the Scan button. The Review Configurations screen appears.
Review your Banner and Preference Center configurations.
Click the Confirm button.
When the website scan is finished, the status will display as Completed.
To configure a custom Experience Kit
-
On the Assign to Container screen, click the Create Custom Experience Kit button. The Select Audience screen appears.
-
Enter a name and select the framework(s) for your Experience Kit.
Configure additional languages by clicking the Manage Languages button.
-
Click the Next button. The Choose a Cookie Banner Layout screen appears.
Configure your banner layout and branding.
-
Click the Next button. The Choose a Preference Center Layout screen appears.
Configure your Preference Center layout and branding.
-
Click the Next button. The Review Configurations screen appears.
Review your configurations and make changes as needed.
Click the Confirm button.
Add Website Screen Reference
To re-scan an existing website
On the menu, select . The Websites screen appears.
Hover over the row for the website which you want to re-scan until the Context Menu icon
appears.
Click the Context Menu icon. The menu appears.
-
Select . The Re-audit modal appears.
Complete the fields. For more information, see Add Website Screen Reference.
Click the Start Scan button.
To reassign a website to a different organization
On the menu, select . The Websites screen appears.
Hover over the row for a website you want to reassign until the Context Menu icon appears.
Click the Context Menu icon. The menu appears.
-
Select . The Reassign Organization modal appears.
In the Organization field, select the organization to which you want to assign the website.
Click the Reassign button.
To schedule a website scan
On the menu, select . The Websites screen appears.
Hover over the row for the website for which you want to schedule a scan until the Context Menu icon appears.
Click the Context Menu icon. The menu appears.
-
Select . The Schedule Scan modal appears.
-
Configure the fields.
Click the Save button.
Note
You can schedule scans for your domains based on new content being added and maintaining your Cookie Consent implementation. Read more here.
On the menu, select . The Websites screen appears.
Hover over the row for an In Progress website scan you want to stop until the Context Menu icon appears.
Click the Context Menu icon. The menu appears.
Select . A confirmation modal appears.
Click the Confirm button.
Note
If a scan is Scanning, the scan will stop, and the results will be available as the latest scan result.
If a scan is Pending and there are no previous scans completed on the site, the scan is removed.
If a scan is Pending and there is a history of one or more successful scans, then only the new scan is removed from the pending list, and previous reports will be available as before.
To view a website's activity history
In , you can access an audit log of activity for each of your domains to review any changes made over time.
On the menu, select . The Websites list screen appears.
Select a website from the list. The Website Details screen appears.
Go to the Activity tab. The Activity screen appears.
Review the website's activity history.
On the menu, select . The Websites list screen appears.
-
Click the Column Selector icon. The Website Column Selector modal appears.
-
Use the arrow keys to configure column visibility for the Websites list screen. This configuration will be reflected in the export.
Note
Column sorting will also be reflected in the export file. Click the header of a column to sort the list screen in ascending or descending order of that column's data.
Click the Save button.
Click the Export button in the header. A confirmation modal appears.
Click the Confirm button.
-
Click the Notifications icon
. A website data export appears in the Notifications popover.
Click Download. An excel report downloads to your device.
View the data export.
To delete a website from the scanner
On the menu, select . The Websites screen appears.
Hover over the row for a website you want to delete until the Context Menu icon appears.
Click the Context Menu icon. The menu appears.
Select . A confirmation modal appears.
Select the data you want to delete.
Click the Confirm button.
Cookie Scanner IP Addresses
Follow the links to find the current scanner IP addresses.
OneTrust
CookiePro