Skip to main content
Version: NG-3.1

Data Explorer

Overview​

Data Explorer is the vuSmartMaps module used to explore, search, analyze, and visualize logs and other table-based data. It was previously called Log Analytics, but it now supports more than log tables. It can also work with structured data tables that may or may not contain a timestamp column.

This feature helps users retrieve relevant records, narrow down large datasets, inspect individual entries, identify trends, and investigate issues faster. It combines table-based exploration with filtering, search, trend visualization, saved searches, export, and detailed record viewing. It also supports Vunet Query Language (VQL) for text-based querying.

Data Explorer supports three table types:

  • Log tables for traditional log analysis.
  • Data tables with timestamp column for structured time-based analysis.
  • Data tables without timestamp column for static data analysis without time-based controls.

The module also supports optimized ingestion, compression-based storage efficiency, optional retrieval of historical data through S3 API-based object storage, role-based access control, and data masking for sensitive data.

Why This Feature Is Useful​

In banking and payment environments, teams often need to investigate issues across large volumes of system and transaction data. This may include logs from payment services, middleware layers, APIs, and other operational systems. Data Explorer helps teams find the right records quickly and understand what happened during an issue window.

This is useful because the feature allows users to:

  • Search records using VQL.
  • Build structured filters on fields.
  • View trends over time when timestamps are available.
  • Inspect full records in detail.
  • Reuse investigations through saved searches.
  • Share findings with other users.
  • Export results for external analysis or evidence collection.

Example Scenario​

A payment operations team wants to investigate a spike in transaction-related errors during a particular period.

They open Data Explorer, choose the correct Data Store and Table, set the time range, and review the trend chart and matching records. They then use Build Filter to narrow results to records containing the relevant values and inspect individual records using the detailed view. If they want to reuse the same investigation later, they save the search and share it with another team.

When to Use This Feature​

Use Data Explorer when you need to:

  • Search logs or structured table records.
  • Investigate an incident or service issue.
  • Analyze records for a selected time period.
  • View the latest live data for timestamp-based tables.
  • Apply one or more filters to isolate specific records.
  • Inspect the full content of a single record.
  • Review the most frequent values in a column.
  • Save and reuse a commonly used search.
  • Share a search view with other users.
  • Export records in CSV or JSON format.

Use log tables when the goal is traditional log investigation, including Surrounding Logs. Use data tables when the goal is record-based analysis of structured data. If the table has a timestamp column, time-based analysis remains available. If not, time-based controls are disabled.

Use Data Explorer when you need to search logs or structured table records, apply filters, inspect records, save searches, share views, or export records.

Comprehensive Understanding​

When you open Data Explorer, you first land on a page where you select the Data Store and Table to start a new analysis. The document states that Hyperscale is selected as the default data store. It also notes that users now see only the tables they have permission to access.

Main UI areas​

Data Store​

Lets you choose the database connection instance to analyze. The guide explains that Data Stores are database connection instances configured in the Data Modeling Workspace. Each Data Store represents a separate connection to a database instance, internal or external, used for analysis. The guide also states that only VuNet HyperScale database instances are supported for Data Explorer, and the default internal HyperScale instance is available in all systems.

Table​

Lets you choose the table from which records will be fetched. The guide mentions that user-friendly labels are now shown instead of raw table names for better readability.

Global Time Selector​

Appears at the top right for tables with timestamp columns. It allows users to focus analysis on a selected time range. After a search is run, the page also shows the last refresh status, such as Updated 1m ago.

Live Data Toggle​

Available only for tables with timestamp columns. When enabled, it shows the latest 500 records from the last 5 minutes and refreshes every 10 seconds.

Share Button​

Generates a direct link to share either the current active search query or a saved search. The UI also includes a User Guide tab that redirects users to the Data Explorer user guide.

Save / New-Load / More Actions​

  • Save opens a menu with Save and Save As
  • For a new search, Save is disabled and Save As must be used
  • For an existing saved search, Save updates it
  • For a saved search, Save As behaves like a clone
  • New/Load starts a new search or opens saved searches
  • More Actions is used for actions such as saved search permissions

Lets users enter VQL-based text queries. The VQL button opens the VQL help documentation in a new tab. The search box also shows suggestions from search history and displays the 10 most recent searches. The guide also notes that filters applied to the message field are visually highlighted in the result table.

Build Filter​

Lets users create filters by selecting a column, operator, and value. Multiple filters can be added. Even if a column is not currently selected for display in the table, the search can still run on that column. The guide also states that the log_uuid filter is no longer supported.

Columns Sidebar​

Lets users choose which columns to display. For data tables, the first four columns in alphabetical order are selected by default. A maximum of 25 columns can be selected at a time. The available columns may vary depending on the Data Store and Table.

Trend Chart and Table View​

The right side of the screen shows the trend chart and the record table. For timestamp-enabled tables, the chart shows the Document Count Trend, which represents the total number of records in the selected time range.

Select the correct Data Store and Table before analysis. Users only see the tables they have permission to access.

Step-by-Step Instructions​

Start New Analysis​

  1. Open the left navigation menu and go to Observability Hub → Data Explorer.
  2. On the landing page, select the required Data Store.
  3. Select the required Table.
  4. Click Start a New Analysis.
  5. Once the Data Store and Table are selected, Data Explorer shows matching data for the selected time range without any other filters.

Choose The Time Range​

  1. For tables with timestamp columns, use the Global Time Selector at the top right to choose the required time range.
  2. By default, timestamp-enabled tables show data for the last 15 minutes. The guide gives Last 90 days as an example of a longer range.
  3. After the time range is selected, the trend chart, where available, and the record table are updated.
  4. For tables with timestamp columns, use the Global Time Selector at the top right to choose the required time range.
  5. By default, timestamp-enabled tables show data for the last 15 minutes. The guide gives Last 90 days as an example of a longer range.
  6. After the time range is selected, the trend chart, where available, and the record table are updated.

Use Live Data​

  1. If the selected table has a timestamp column, you can enable Live Data.
  2. This shows the most recent 500 records from the last 5 minutes and refreshes automatically every 10 seconds.
  3. Use the refresh button beside the Live Data toggle when needed.
  4. If the selected table has a timestamp column, you can enable Live Data.
  5. This shows the most recent 500 records from the last 5 minutes and refreshes automatically every 10 seconds.
  6. Use the refresh button beside the Live Data toggle when needed.

Search Using VQL​

  1. Enter a text query in the search box to retrieve records using VQL.
  2. Click the VQL button if you want to open the VQL help page in a new tab.
  3. The system may show suggestions based on your recent search history. It displays the 10 most recent searches.
  4. Enter a text query in the search box to retrieve records using VQL.
  5. Click the VQL button if you want to open the VQL help page in a new tab.
  6. The system may show suggestions based on your recent search history. It displays the 10 most recent searches.

Search Using Build Filter​

  1. Click Build Filter next to the search box.
  2. Click Add Filter.
  3. Select the column to filter.
  4. Select the operator.
  5. Enter the value to match.
  6. Click Apply.
  7. Click Build Filter next to the search box.
  8. Click Add Filter.
  9. Select the column to filter.
  10. Select the operator.
  11. Enter the value to match.
  12. Click Apply.

Additional filter behavior described in the guide:

  • Multiple filters can be added at the same time.
  • Multiple filters operate as an AND condition.
  • If filters and VQL are both used, they also operate together as AND.
  • Clicking a filter lets users temporarily enable or disable it.
  • From More Actions, users can modify or delete a filter.
  • The Filter Actions control lets users enable, disable, or delete all filters directly.
  • Browser back and forward buttons can be used to move through previous filter/search states because those actions are recorded in browser history.

Select and Manage Columns​

  1. Use the Columns panel on the left to choose which fields should appear in the table.
  2. For data tables, the first four columns in alphabetical order are selected by default.
  3. You can rearrange columns by dragging them in the Columns panel or directly within the table.
  4. Columns can be resized by dragging their edges.
  5. Use the Columns panel on the left to choose which fields should appear in the table.
  6. For data tables, the first four columns in alphabetical order are selected by default.
  7. You can rearrange columns by dragging them in the Columns panel or directly within the table.
  8. Columns can be resized by dragging their edges.

The guide also notes improved table resizing behavior:

  • Table layout automatically adjusts when columns are added or removed.
  • Manual column resizing is remembered by the system.
  • New columns start with a minimum width of 150 pixels.
  • When columns are removed, free space is redistributed across the remaining columns.

Explore Column Values​

  1. To inspect the most frequent values in a field, click the horizontal ellipsis next to that field in the Columns section.
  2. Data Explorer then shows the Top 5 values for that column. For data tables, this is available for all columns. Each value shows its count and percentage within the column.
  3. The guide notes that this expansion is available for all fields except message, because message is unique, descriptive, and unquantified.
  4. From the Top 5 values panel, you can use Filter for value to include that value or Filter out value to exclude it.
  5. To inspect the most frequent values in a field, click the horizontal ellipsis next to that field in the Columns section.
  6. Data Explorer then shows the Top 5 values for that column. For data tables, this is available for all columns. Each value shows its count and percentage within the column.
  7. The guide notes that this expansion is available for all fields except message, because message is unique, descriptive, and unquantified.
  8. From the Top 5 values panel, you can use Filter for value to include that value or Filter out value to exclude it.

Use Display Controls​

  1. Use the Columns toggle to hide or show the sidebar.
  2. Use Compact View if you want multiline content such as logs to appear in a single-line format. By default, multiline data is shown within cells up to about eight lines, and longer content may be truncated for readability. Compact View flattens it into a single line.
  3. Use Toggle Trend Chart to hide or show the chart above the table. This option is available only for tables with timestamp columns. When the chart is hidden, the table uses more space.
  4. Use Maximize View to expand the table to full-screen mode. Click again to return to the default layout.
  5. Use the Columns toggle to hide or show the sidebar.
  6. Use Compact View if you want multiline content such as logs to appear in a single-line format. By default, multiline data is shown within cells up to about eight lines, and longer content may be truncated for readability. Compact View flattens it into a single line.
  7. Use Toggle Trend Chart to hide or show the chart above the table. This option is available only for tables with timestamp columns. When the chart is hidden, the table uses more space.
  8. Use Maximize View to expand the table to full-screen mode. Click again to return to the default layout.

View Record Details​

  1. For log tables, click a log entry to open its detailed view. The drawer shows full log details. Empty fields are shown under a separate empty field section. The guide also states that users can copy the log and export it from this detailed view.
  2. For data tables, click View Details in the first column of a row. This opens a drawer showing all column values for that record.
  3. For log tables, click a log entry to open its detailed view. The drawer shows full log details. Empty fields are shown under a separate empty field section. The guide also states that users can copy the log and export it from this detailed view.
  4. For data tables, click View Details in the first column of a row. This opens a drawer showing all column values for that record.

Use Surrounding Logs for Log Tables​

  1. In log tables, click Surrounding Logs from the Actions column if you want to see nearby log entries around a selected log.
  2. The system shows the 100 preceding and 100 succeeding log lines in chronological order.
  3. In log tables, click Surrounding Logs from the Actions column if you want to see nearby log entries around a selected log.
  4. The system shows the 100 preceding and 100 succeeding log lines in chronological order.

Important behavior noted in the guide:

  • Any applied filter is automatically disabled when checking surrounding logs.
  • The system temporarily disables applied filters to locate surrounding logs.
  • Table-level filters are preserved while locating surrounding logs.
  • Users can still mute or unmute existing filter pills by clicking them.
  • Users cannot add or edit filters in Surrounding Logs view.
  • Changes to selected columns made in Surrounding Logs view are not preserved when returning to the main page.
Use Surrounding Logs only for log tables. For data tables, use View Details to inspect a record.

  1. Click Save in the top right corner.
  2. For a new search, choose Save As.
  3. Enter the search name and optional description.
  4. If needed, enable Store time with Saved Search for timestamp-enabled tables. When enabled, the saved search opens with that same time range by default.
  5. Click Save.
  6. To open saved searches later, click New/Load and then Load Search.
  7. Saved searches can also be deleted from the load section.
  8. Click Save in the top right corner.
  9. For a new search, choose Save As.
  10. Enter the search name and optional description.
  11. If needed, enable Store time with Saved Search for timestamp-enabled tables. When enabled, the saved search opens with that same time range by default.
  12. Click Save.
  13. To open saved searches later, click New/Load and then Load Search.
  14. Saved searches can also be deleted from the load section.

important

if Live Data is active and the time-range save option is enabled, the system saves data for the previous 15 minutes.

Manage Access Permissions For Saved Searches​

  1. To manage saved search permissions, go to More Actions → Permissions.

  2. For each role, one of three permissions can be assigned:

  3. To manage saved search permissions, go to More Actions → Permissions.

  4. For each role, one of three permissions can be assigned:

    • View: user can view only; Save is disabled.
    • Modify: user can modify based on object-level permission granted.
    • None: no access granted.

Share and Export Results​

  1. Use Share to generate a direct link for either a saved search or the current active search query.
  2. Use Share to generate a direct link for either a saved search or the current active search query.

  1. Use Export to download the results. The export screen allows CSV or JSON format and lets users choose a limit of 100, 500, 1000, or up to 5000. Then click download to save the file locally.
  2. Use Export to download the results. The export screen allows CSV or JSON format and lets users choose a limit of 100, 500, 1000, or up to 5000. Then click download to save the file locally.

Important export notes from the guide:

  • Only the columns currently selected in the table are exported.
  • If sorting is applied, the export preserves that sorting.
  • To include all columns, users must select Export all columns.

What Happens After the Steps​

After you select a Data Store and Table and begin the analysis, Data Explorer shows matching records for the selected time range. Depending on the table type, you may also see a trend chart and live data controls. Users can then refine results using VQL or filters, control which columns appear, inspect Top 5 values for fields, and open detailed views of individual records.

If the investigation needs to be reused, the search can be saved. If it needs to be shared, a direct link can be generated. If it needs to be taken outside the platform, the result set can be exported in CSV or JSON.

Save recurring investigations as saved searches, and use Share or Export when findings need to be reused or shared.

Tips / Best Practices​

  • Use the correct table type for the task. Log tables are best for log investigation. Data tables are best for structured record analysis.
  • For timestamp-based tables, start with the right time range before applying detailed filters.
  • Use Build Filter when you want a guided approach, and use VQL when you want text-based searching.
  • Use Top 5 values to quickly understand the most common values in a column before building more precise filters.
  • Keep only the most useful columns selected, especially because only selected columns are exported unless Export all columns are chosen.
  • Save recurring investigations as saved searches so they can be reopened or shared later.
  • Use Compact View when rows contain long multiline content and you need a denser table layout.
  • Use Maximize View when comparing many rows or columns and you need more working space.

Troubleshooting​

  1. Issue: No records are displayed after selecting the Data Store and Table.

    • Possible Cause: The selected table may not have matching records for the selected time range, or the selected Data Store/Table may not be the correct one for the analysis. Data Explorer shows matching data based on the selected Data Store, Table, and time range.
    • Solution: Verify that the correct Data Store and Table are selected. Then adjust the time range from the global time selector and refresh the data. For timestamp-enabled tables, start with a wider time range and then narrow it down after confirming that records are available.

  2. Issue: The required table is not visible while selecting a table in Data Explorer.

    • Possible Cause: Only the tables that the user has access to are displayed. The document also notes that, to appear in the Data Explorer table listing, the table must contain fields such as timestamp, message, log_uuid, and message_lower.
    • Solution: Check whether the user has permission to access the table. If access is missing, refer to the User Management configuration. Also verify that the table contains the required fields for listing and analysis.

  3. Issue: The Live Data toggle is not visible or cannot be used.

    • Possible Cause: Live Data is available only for tables with timestamp columns. Data tables without a timestamp column disable time filters, the Live Data toggle, and trend charts.
    • Solution: Use a timestamp-enabled table if live data monitoring is required. If the selected table does not have a timestamp column, use the normal table view and filters for record-based analysis.

  4. Issue: The trend chart is not visible on the Data Explorer page.

    • Possible Cause: Trend charts are available only when the selected table supports time-based analysis. For data tables without a timestamp column, trend charts are disabled.
    • Solution: Confirm whether the selected table has a timestamp column. If it does, select the required time range and refresh the data. If the table does not have a timestamp column, use the table view, filters, Top 5 values, and View Details option for analysis.

  5. Issue: The applied filters do not show the expected records.

    • Possible Cause: Filtering behavior depends on the table type. Log tables support filtering on designated columns, while data tables allow filtering on any column. Data Explorer also supports VQL-based search and Build Filter-based filtering, so incorrect field/operator/value selection can affect results.
    • Solution: Check whether you are using a log table or a data table. Select the correct column, operator, and value in Build Filter. If using VQL, verify that the query is written for the correct field. Use filter enable/disable options to test filters one by one.

  6. Issue: The exported file does not include all expected columns.

    • Possible Cause: Only the data from the columns selected in the table is exported by default. The export screen supports CSV and JSON download with limits such as 100, 500, 1000, and up to 5000 records.
    • Solution: Before exporting, select all required columns in the table. To include every column, choose Export all columns. Then select the required export format and row limit, and download the file.

FAQs​

What is Data Explorer in vuSmartMaps?

Data Explorer is a module in vuSmartMaps that helps users explore, analyze, and visualize logs as well as structured data. It supports advanced filtering, querying, and trend analysis to help users quickly find useful insights from large volumes of data.

How do I access Data Explorer?

Go to Observability Hub → Data Explorer from the left navigation menu. Then select the required Data Store and Table, and click Start a New Analysis.

What types of tables are supported in Data Explorer?

Data Explorer supports three table types:

  • Log Tables

  • Data Tables with timestamp column

  • Data Tables without timestamp column

    Each type supports different analysis behavior depending on whether time-based analysis is available.

What is the difference between log tables and data tables?

Log tables support traditional log analytics features such as Surrounding Logs, trend visualization, and an Actions column. Data tables support filtering on any column, show Top 5 values for all columns, and provide a View Details button for each row instead of Surrounding Logs.

What does the Live Data option do?

For tables with a timestamp column, the Live Data option shows the latest 500 records from the last 5 minutes and refreshes automatically every 10 seconds.

How can I search or filter data in Data Explorer?

You can search data in two ways:

  • By entering VQL-based text queries in the search box
  • By using Build Filter to apply column-based filters Multiple filters can be added, and they work together as an AND condition.
Can I filter data using columns that are not visible in the table?

Yes. Even if a column is not selected for display in the table, you can still use it in filters while building your search query.

How can I view complete details of a single record?

For log tables, click directly on the log entry to open its detailed view. For data tables, click the View Details button in the first column to open a drawer showing all field values for that record.

Can I save and share my searches?

Yes. You can save a search using Save As, reload it later using New/Load, and share it using the Share button. Saved searches can also have role-based permissions such as View, Modify, or None.

Can I export search results?

Yes. Search results can be exported in CSV or JSON format. You can export up to 5000 records, and the export will include the selected table columns unless you choose Export all columns.