Technical chni cal Produ Product ct Desc scrip riptio tion n TEMS™ Discovery Device 10.0
NT12-3246, 1.0, 5/13/2013
1
2
NT12-3246, 1.0, 5/13/2013
© Ascom. All rights rights reserved. reserved. TEMS is a trademark of Ascom. All other trademarks t rademarks are the property of their respective holders. NT12-3246, 1.0, 5/13/2013
3
Contents 1
Introduction 1.1
Who Is TEMS Discovery Device Intended For? ......................................................... ....... 8
1.2
Capabilities..................................................................... ................................................... 8
1.3
1.4
2
2.2
Drive Test Data Import ..................... ...................... ..................... ..................... .............. 8
1.2.2
Call Trace Import ........................................................................................................... 8
1.2.3
IP Trace Import .............................................................................................................. 8
1.2.4
Network Configuration Import.................. ....................... .................... ....................... ..... 9
1.2.5
GIS Data Import ............................................................................................................. 9
1.2.6
Antenna Data Import.................... ..................... .................... ..................... .................... 9
1.2.7
Coverage Map Import .................................................................................................... 9
1.2.8
Handover Matrix Import.................................................................................................. 9
1.2.9
Import API.................. ...................... ..................... ..................... ..................... ............... 9
1.2.10
Operating Systems ........................................................................................................ 9
Functionality Levels .................................................................. ....................................... 10 1.3.1
Replay feature set .................... ..................... ..................... .................... ..................... .10
1.3.2
Standard feature set ................................................................................................... 10
1.3.3
Professional feature set ............................................................................................... 10
3.2
1
Where to Find Out More............................................................ ...................................... 10
11
Easy and Extensive Customization Capabilities......................................................... Capabilities......................................................... ..... 11 2.1.1
Network Data Integration ............................................................................................. 12
2.1.2
Scripting Capabilities ................................................................................................... 13
2.1.3
Reporting Capabilities.................. ....................... .................... ..................... ................ 14
2.1.4
Problem Set Capability................................................................................................. 15
2.1.5
Analysis Set................... .................... ..................... ..................... .................... ............ 15
2.1.6
Efficient Way of Working .................. .................... ..................... ..................... .............. 15
Low Total Cost of Ownership ............................................................... ........................... 16 2.2.1
Free Access to GIS Databases ................... ..................... .................... ..................... ... 16
2.2.2
Multivendor Logfile Logfile Support .................................. ..................... .................... .............. 17
Key Featu Featu res 3.1
4
1.2.1
Overview 2.1
3
6
18
Flexible Deployment W ith Instant Access to Data ........................................................... 18 3.1.1
Data Organization and Management.................. ..................... ..................... ................ 19
3.1.2
Full Access to Information Elements .................. ..................... ..................... ................ 20
3.1.3
Message Flow Diagram ............................................................................................... 21
3.1.4
Automatic Data Processing Processing ..................... ..................... .................... ..................... ....... 22
3.1.5
Versatile Data Binning ................................................................................................. 24
3.1.6
Powerful Data Filtering..................... ...................... ..................... ..................... ............ 25
3.1.7
Diagnostics .................................................................................................................. 25
3.1.8
Extensive Data Sharing Across the Organization ..................... ...................... .............. 26
Analysis Views .............................................................. .................................................. 27 3.2.1
Map View................... .................... ..................... ..................... ..................... ............... 27
3.2.2
Time-series Chart View.................... .................... ..................... ..................... .............. 29
3.2.3
Message View ............................................................................................................. 30
3.2.4
Table View .................... ..................... ..................... .................... ..................... ............ 31
NT12-3246, 1.0, 5/13/2013
3.3
4
5
3.2.5
Point Details View........................................................................................................ 32
3.2.6
Instant Chart View ....................................................................................................... 33
3.2.7
Metric Correlation View................................................................................................ 34
3.2.8
Problem Summary View .............................................................................................. 34
3.2.9
Histogram View ........................................................................................................... 35
3.2.10
Multidimension Statistic View....................................................................................... 36
3.2.11
Sector Statistic View View ................... ...................... ..................... ....................... ............... 37
Scripting and Reporting ...................................... ............................................................ 38 3.3.1
Script Builder ............................................................................................................... 38
3.3.2
Reporting..................................................................................................................... Reporting..................................................................................................................... 39
3.3.3
Highly Automatic Batch Printing.................... ..................... ..................... ..................... 40
TEMS TEMS Disco very Device: Drill ing Down to Measur Measur ement Data Data
41
4.1
Contents and Characteristics .............................................................. ............................ 41
4.2
Further Examples of How to Use TEMS Discovery Device ............................................. 42 4.2.1
Dropped Call Analysis ................................................................................................. 42
4.2.2
Analyzing TEMS TEMS Pocket Indoor Measurement.................... ..................... .................... 43
4.2.3
Sector-Based Statistics................................................................................................ 46
Appen Ap pendi di ces
47
5.1
Supported Operating Systems ............................................................ ............................ 47
5.2
Logfile Support ............................................................... ................................................. 47
5.3
Supported Technologies ..................................................................... ............................ 47
5.4
Data Processing............................................................. ................................................. 48
5.5
Cell Configuration Support ........................................................ ...................................... 48
5.6
Handover Matrix............................................................. ................................................. 49
5.7
GIS.......................................................... .................................................................. ...... 49
5.8
Reporting ............................................................................................. ........................... 49
5.9
Analysis Views .............................................................. .................................................. 50
5.10
Map Support ............................................................................ ....................................... 50
5.11
Reporting and Scripting ...................................... ............................................................ 51
5.12
Export ............................................................................................................................. 51
5.13
Data Organization and Data Sharing .............................................................................. 51
NT12-3246, 1.0, 5/13/2013
5
1
Introduction
For true benchmarking, monitoring, rollout, and analysis and troubleshooting of UMTS, CDMA, TDSCDMA, WiMAX, and LTE wireless networks, Ascom Network Testing offers the post-processing tool TEMS™ Discovery Device. TEMS Discovery Device is highly configurable and extremely user-friendly. It allows engineers to easily assess wireless performance and quickly pinpoint network problems. Highly automatic data processing increases the efficiency and provides instant access to knowledge about the behavior and performance of your network. No other product can match the variety of information elements that TEMS Discovery Device handles, allowing thorough analysis of the collected data. With comprehensive GIS data support and display you can pinpoint and visualize network problems. Analyzing air interface measurements in TEMS Discovery Device is the only way to obtain a truly adequate picture of the network, thanks to the many unique and advanced features within TEMS Discovery Device that competing reporting and analysis products cannot match. TEMS Discovery Device helps operators to: •
Incr ease revenue: Problems can be located and fixed before they start affecting customers, improving customer satisfaction and reducing churn. Fewer blocked and dropped calls mean more call time and higher earnings. A high quality of service also helps to attract new subscribers.
•
Optimize investments: A wireless telecom network represents a huge investment and needs optimization to bring the best possible return. TEMS Discovery Device helps when analyzing the collected data, allowing you to make wise investment decisions. It can also be used to test new features before rollout to ensure their performance in the live network.
•
Maximize their competiti ve edge: With TEMS Discovery Device the entire network is scrutinized down to the smallest detail. Every single event, all important key performance indicators (KPIs), any signs of network degradation, and many other network issues are examined continuously. This keeps your network at the highest possible quality, leaving competitors behind.
•
Speed up rollout and verifi cation of new technology: Analyzing huge data volumes takes a lot of time and with TEMS Discovery Device the process can be simplified and focused on detecting and solving problems – not only processing data. W ith the introduction of the new diagnostics features in TEMS Discovery Device, users can pinpoint issues in network configuration and other problems that can be time-consuming to identify. Using diagnostics, they can find the signatures of the problems and highlight them.
TEMS Discovery Device provides comprehensive data processing for both packet-switched and circuit-switched data and supports all major radio technologies. This data processing uses multiple data sources, such as measurement data from drive test devices and scanners, as well as GIS data, network cell configuration and parameters, neighbor lists, and antenna patterns. To complete the picture, drive test data can be synchronized with network call traces and IP traces (libpcap). For LTE, for example, TEMS Discovery Device supports analysis of both LTE scanner data and LTE device data from all supported drive test tool vendors, more than 2,000 LTE information elements, events, and cell data items.
6
NT12-3246, 1.0,5/13/2013
The TEMS Discovery Device portfolio is easy t o configure according to your post-processing needs, starting from single logfile analysis in TEMS Discovery Device Replay, up to a fully automated centralized post-processing solution based on TEMS Discovery Device Enterprise.
With TEMS Discovery Device, you will increase your efficiency and profit via: Easy and extensive cust omization capabilities: The various views and Data Explorers can be arranged in countless combinations. Multiple sub-views for easy side-by-side comparison or the more conventional views with maps (including Google Maps and Microsoft Bing Maps, through license agreements), time series, messages, tables, histograms, or reports – the choice is yours. In addition, TEMS Discovery Device includes a completely customizable report template builder, key information settings, analysis sets, point detail configuration, and more.
Figure 1.
Example of the highly configurable user interface of TEMS Discovery Device
Low total cost of ownership: The software can be deployed with minimal IT system requirements and with minimal dependence on third-party software. Large volumes of data are handled with low memory demand, and the intuitive interface provides a fast learning curve and reduced analysis time. There is also integrated online access to free or low-cost GIS data sources. Flexible deployment architecture: Network configuration is easy to set up with minimal platform requirements and allows for collaboration of engineers across functional roles and geographies. The processed data is instantly accessible across the organization and provides highly organized information, with an unlimited number of composite data sets. Multivendor capabilities. TEMS Discovery Device handles a variety of drive test tools and is thus the only post-processing tool you need to learn, maintain, and upgrade.
NT12-3246, 1.0, 5/13/2013
7
1.1
Who Is TEMS Disco very Device Intended For?
TEMS Discovery Device is designed to benefit all levels of the operator’s organization. •
RF engi neers are notified of all sorts of local malfunctions (weak signal reception, bad C/I, low data throughput, etc.), prompting them to try out various tweaks to the network configuration. TEMS Discovery Device provides easy access to information elements as well as on-demand data extraction and intelligence embedding with the Script Builder, for pinpointing and evaluating network problem areas. Advanced R&D staff can also use TEMS Discovery Device as a research tool in the rollout stage of emerging technologies, because it provides customization of scripts.
•
Managers are able to supervise the organization’s processes and services. They can keep track of any events or metrics of interest (dropped call rate, to give just one example) by studying reports easily defined with the Report Builder. They are aided in making decisions on investments and organizational improvements. By getting a tighter grip on the network’s end-to-end voice and data quality, the company is also in a better position to offer customers reliable service level agreements.
•
Networ k pl anners learn about spots with recurrent problems by requesting statistics confined to specific areas. This helps reveal deficiencies in the network layout or the underlying theoretical models, while also providing input for improvements. As a result, planners are able to boost network utilization and get maximum mileage out of the existing network before new investments are made.
•
Marketing staff can extract statistics on usage patterns, furnishing the basis for precisely targeted advertising campaigns. Being more intimately familiar with the network’s quality of service, marketers can also work out more advanced and precise charges for various services. It is less risky to promise, and charge for, quality that has been thoroughly assured.
•
The customer care unit can order coverage information to enlighten customers who are making complaints or enquiries. Complaints can be cross-checked against network status reports to help determine whether a problem resides in the network or in the customer’s handset.
1.2
Capabilities
1.2.1
Drive Test Data Impor t
TEMS Discovery Device supports the import of native drive test data from the major drive test tool vendors (see Appendix 5.2). With the generic data import, any text-based (.tab or .csv) file format can be imported to T EMS Discovery Device. It is easy to define an import schema by dragging and dropping.
1.2.2
Call Trace Import
LTE and WCDMA call traces from Ericsson can be imported and synchronized with the drive test data.
1.2.3
IP Trace Import
IP trace data (libpcap) collected together with drive test data can be synchronized and analyzed in TEMS Discovery Device. 8
NT12-3246, 1.0,5/13/2013
1.2.4
Netwo rk Configu ration Import
Site data can be imported as network configuration files. TEMS Discovery Device supports import of cell configuration data from multiple network planning tool and drive test tool vendors. Network configuration data can also be imported from Ericsson OSS (Bulk CM), as shown in Appendix 5.4. With the generic network configuration import, any text-based (.tab or .csv) file format can be imported to TEMS Discovery Device. It is easy to define an import schema by dragging and dropping. Network configurations imported into TEMS Discovery Device can be exported to Ascom Network Testing’s TEMS XML cell file format.
1.2.5
GIS Data Import
For map display, there is a wide selection of free or low-cost yet high-quality data available. TEMS Discovery Device supports approximately 100 commonly used GIS file formats, including: •
Automatic merging of GIS data with different sources, formats, and projections
•
Terrain elevation data, raster images, and vector data
•
Free access to online GIS databases
•
Google Maps/Microsoft Bing Maps as online maps in addition to ordinary map formats or download maps from map servers
1.2.6
Ant enna Data Import
The network configuration file can contain “antenna type” as a parameter of the sector table. TEMS Discovery Device is able to provide a view for the antenna pattern of a sector.
1.2.7
Coverage Map Import
Coverage maps exported from external planning tools can be imported into TEMS Discovery Device. Those coverage maps can be displayed in the Map View for viewing, or used to generate delta metrics.
1.2.8
Handover Matri x Import
Handover matrices can be imported. Based on those matrices, TEMS Discovery Device can perform neighbor list tuning and eventually export a neighbor list work order for implementation.
1.2.9
Impo rt API
TEMS Discovery Device provides an API for users to develop their own parser to import data into TEMS Discovery Device. This means that you can import native data from any tool and any type of data.
1.2.10
Operating Systems
TEMS Discovery Device is a .NET application that can be used with most of the Microsoft operating systems. See Appendix 5.1.
NT12-3246, 1.0, 5/13/2013
9
1.3
Functio nalit y Levels
TEMS Discovery Device is available in four f eatures levels of functionality: •
Replay f eature set performs single logfile analysis.
•
Standard feature set 1 includes all the functionality needed to analyze drive test data, multiple logfile analysis.
•
Professional f eature s et is an advanced version with enhanced functionality for automated reporting and analysis.
1.3.1
Replay featur e set
TEMS Discovery Device Replay is a low-cost single logfile post-processing tool for TEMS logfiles. With TEMS Discovery Device Replay you can quickly analyze collected logfiles. For more information, see Appendix tables.
1.3.2
Standard featur e set 1
The Standard version includes multiple logfile analysis capabilities with synchronized views and built-in standard reporting. TEMS Discovery Device St andard 1 is available with a local or network license. For more information, see Appendix tables.
1.3.3
Professi onal feature set
The Professional version includes all of the functionality needed for drive test data analysis and lets you tailor the tool to fit into the process flow. TEMS Discovery Device includes Script Builder, Report Builder, and automatic data processing, just to mention some of the advanced features that can make the analysis efficient. For more information, see Appendix tables.
1.4
Where to Find Out More
For additional information concerning TEMS Discovery Device or other TEMS products, please visit us on the Web at www.ascom.com/networktesting. To sign up for a subscription to TEMS Bulletins, please go to the link above and click “Register for TEMS Bulletins.” This free service includes email notification of T EMS product launches, version upgrades, and patches, as well as our online customer magazine.
1
TEMS Discovery Device with Standard feature set bun dled with TEMS Investigation supports only logfiles collected with TEMS Investigation.
10
NT12-3246, 1.0,5/13/2013
2
Overview
2.1
Easy and Extensive Customi zation Capabilit ies
With TEMS Discovery Device, you have the flexibility to configure a wide range of items, from simple view layouts and key information settings to sophisticated report templates. You can embed your company’s preferences, expertise, and knowledge into the tool and thereby define your sets of preferences or templates. Post-processing with TEMS Discovery Device fulfills a full range of needs: •
Initial tuning: Find missing neighbors, evaluate your coverage, and review your services, among other tasks.
•
Network monitoring: Key performance indicators (KPIs) for voice, data services, streaming video, and video telephony help you to keep track of the quality of your network. They also serve as good decision support for your improvements.
•
Network optimization: The tool assists in pinpointing network problems, including root cause analysis.
•
Benchmarking: Find out if you are best or worst or somewhere between, and identify the differences between you and your competitors.
•
Coverage analysis: Coverage is not only about measuring your signal strength values, but also accessibility of different services, limited service plots, and no-coverage plots. With various drive test tools you can perform measurements on your roaming partners to find out if they are fulfilling their requirements. TEMS Discovery Device coverage plots can also be used in your planning tool.
•
Troubleshooting: With TEMS Discovery Device, the troubleshooting of tricky problems that need multiple data sources (drive test data, call trace data, IP trace data, etc.) can be done in one tool with full synchronization.
•
Indoor: TEMS Discovery Device can import indoor measurements including RF data, pinpoints, and maps in a single operation, if the indoor map is not positioned; the map can be geolocated with a few clicks.
NT12-3246, 1.0, 5/13/2013
11
2.1.1
Networ k Data Integr ation
Full access to various types of data and simultaneous display of this data enhances your understanding of the network’s performance. You can customize what to display on the screen as well as how it is displayed.
Figure 2.
Customized display of network data
Some of the useful functions that enable you to find what you are looking for are listed below:
12
•
Integration of imported network configuration data, parameters, and neighbor lists
•
Color coding or labeling of all parameters
•
Grouping and searching by one or multiple parameters
•
Linking of drive test data points to sectors
•
Graphical neighbor list display and editing
•
Organization of data in projects
NT12-3246, 1.0,5/13/2013
2.1.2
Script ing Capabili ties
The Script Builder provides an advanced function to extract data from messages and apply customized algorithms to generate new metrics and events. It offers rule-based classification of events and automated analysis, and thus considerable time savings.
Figure 3.
The Script Builder assists in customizing algorithms and extracting specific data
The functions in brief: •
On-demand data extraction and intelligence embedding
•
Simple drag-and-drop access to: o
All metrics
o
All information elements in Layer 3 messages
•
Generation of any metrics, events, and filtering criteria
•
Embedding of proprietary algorithms for standardization across the organization
•
Scripting in C#/C/C++ syntax
•
Generated metrics and events are accessible from all tools and reports, similar to already built-in metrics and events.
NT12-3246, 1.0, 5/13/2013
13
2.1.3
Report ing Capabili ties
Accurate analysis templates and reports are important for the sharing of knowledge. The Report Builder within TEMS Discovery Device is designed to provide great flexibility for generating reports in Microsoft Office Excel ® , Word® or PowerPoint ® formats from drive test data. It eliminates the need to request customized generations from other tool vendors, or to manipulate data manually. There are also predefined and built-in report templates for RAN tuning or acceptance reports. See chapter 5.8. With the Report Builder, reports can be designed either from the measurement database or from the multidimensional database in TEMS Discovery Device Enterprise. The corresponding Map View is automatically included in the report, so there is no need to copy and paste.
Figure 4.
Intuitive Report Builder allows customized reports to be generated on demand
With the Report Builder, all you need to do is drag and drop data objects to generate a final report. Here are the advantages of the tool: •
•
Access to all TEMS Discovery Device events and metrics
Full array of statistical attributes
The ability to drag and drop into any desired cell
Access to all Excel functions
Formulas and equations
Styles
14
NT12-3246, 1.0,5/13/2013
Charting
•
Data filtering per any file/device attributes
•
Operators: for benchmarking
Date: for trending
Ability to use universal templates or specific data
Reports can be sent via email directly to specific recipients or to predefined groups of recipients.
2.1.4
Prob lem Set Capability
A problem set is a group of predefined rules for filtering out specific logfiles (from a large set of logfiles) that contain problems. TEMS Discovery Device is delivered with a number of built-in problem sets for the different technologies. The problem sets can be customized and connected to analysis sets tailored for the analysis of the detected problem.
Figure 5.
Problem set for LTE problem detection
Users can define any combination of problem sets from predefined or user-defined events.
2.1.5
Anal ysi s Set
An analysis set is a group of view layouts (map, time chart, message view, etc.) with precise configuration settings describing the specific names of the metrics to be displayed in a given view. The user can tailor and save analysis sets for specific tasks. To perform an analysis the user selects a data source and opens the selected analysis set. All views included in the analysis set will be opened and populated with selected metrics and events in a single click.
2.1.6
Effic ient Way of Workin g
TEMS Discovery Device offers an efficient way of working that can reduce the time to pinpoint and analyze problems. 1. Load the data that will be analyzed: drive test data, network configurations, call traces, IP traces. 2. Generate a report so problem areas can be prioritized and analyzed in the desired order. 3. Use the problem set to filter out the prioritized problem areas. NT12-3246, 1.0, 5/13/2013
15
4. Launch an analysis set designed to analyze and troubleshoot a specific problem area.
2.2
Low Total Cost of Ownership
TEMS Discovery Device is easy to learn and extremely user friendly. That minimizes the need for training and the amount of startup time required. A getting-started function called “Walk-UThrough” (TEMS Discovery Device Wizard) walks you through some of the most common usage tasks.
Figure 6.
“Walk-U-Through” wizard for work process guidance
Since the tool has an exceptional number of rich features and supports all possible technologies, it is a complete choice for your post-processing needs. The user interface and the way of working are the same in the PC-based analysis tools and the Web-based tool.
2.2.1
Free Access to GIS Databases
TEMS Discovery Device fully integrates Google Maps/Microsoft Bing Maps. Moreover, more than 100 different file formats of terrain elevation data, raster image data, and vector files are supported.
Figure 7.
Free GIS data made instantly accessible by TEMS Discovery Device
Easy access at low cost, thanks to: •
Integrated online access to multiple free GIS databases
•
USGS TerraServer
16
High-resolution terrain elevation data, aerial, or satellite images Free downloading of data for TEMS Discovery Device default boundary or any user-defined area
NT12-3246, 1.0,5/13/2013
•
2.2.2
Web links to popular websites for free or low-cost GIS data sources
Multi vendor Logf ile Support
TEMS Discovery Device supports measurement data from the major vendors of drive test tools. This means that there is only one tool to learn and that it is easy to have a common way of working. TEMS Discovery Device supports logfile formats from TEMS ™, JDSU™, Nemo™, Qualcomm ™, ZK Celltest™, LG™, PCTEL™, and Rohde & Schwarz ™.
NT12-3246, 1.0, 5/13/2013
17
3
Key Featur es
This chapter describes some of the key features of TEMS Discovery Device and is by no means a comprehensive list. The aim is to cover some essentials of how the product works, and to spotlight a number of specific functions that are particularly useful.
3.1
Flexib le Deplo yment With Instant Access to Data
Using drive test data and site data, you can build business intelligence for the entire organization with TEMS Discovery Device. The data is processed and easily accessible for many different purposes by all departments. Following are examples of typical recipients.
18
•
RF engi neers, for analyzing the collected information in detail
•
The sales force, which can be provided with reports showing improvements that have been made and comparisons with competitors
•
Customer support, needing daily updated coverage. Information is highlighted in maps and reports showing poor areas and areas with ongoing network improvements
•
Network operation/rollout, where site acceptance and verification of changes can be monitored
•
Management, interested in KPI reports showing competitor comparisons, trends over time, and summaries of the overall health of the network
•
Government requirements, where TEMS Discovery Device can provide reports f or compliance, such as coverage maps
NT12-3246, 1.0,5/13/2013
3.1.1
Data Organi zati on and Management
To be able to find specific information with little effort and analyze it smoothly, the collected data has to be very well-organized and cleverly managed.
Figure 8.
Organized and well-managed data enables easy access and fast analysis
In TEMS Discovery Device: •
Each raw test file needs to be processed only once.
•
Processed data provides highly organized information.
•
There is incremental merging of new data with existing data.
•
Data is instantly accessible.
•
You have an unlimited number of composite data sets.
•
There is controlled sharing of all processed data across multiple users, for avoiding duplication of work.
•
Old data can be easily archived, and restored if needed with its structure intact.
•
Data from different data sources, such as drive test data, IP trace, and call trace is handled in an integrated manner.
NT12-3246, 1.0, 5/13/2013
19
3.1.2
Full Access to Inform ation Elements
TEMS Discovery Device supports comprehensive message decoding, giving you full access to information elements. Extracting the value of a key information element from over-the-air Layer 3 signaling messages is as simple as clicking the desired information element, or IE, in the built-in IE explorer. You can select any information elements and display their values in the message summary view, eliminating the need to check message details one by one.
Figure 1.
IE explorer reveals signaling message contents
The IE explorer supports: •
Latest 3GPP and 3GPP2 standards
•
Organized Layer 3 information elements
•
“Checked” information element for selective display
•
“Global” and “Local” keyword searches
•
Quick reference and signaling message “encyclopedia” for RF engineers and expert users
To make the analysis complete, drive test data can be correlated with Ericsson Traffic Recordings (UETR) and IP traces (libpcap). The data from all different sources will be synchronized.
20
NT12-3246, 1.0,5/13/2013
3.1.3
Message Flow Diagram
The message flow diagram enhances the ability to analyze the radio signaling or IP signaling by presenting the uplink and downlink signaling as a flow chart including time delays and response times.
Figure 2.
Message flow diagram
NT12-3246, 1.0, 5/13/2013
21
3.1.4
Auto matic Data Processin g
For analysis of large amounts of information to be possible at all, the handling and processing of the collected data must be carried out in a very efficient manner.
Figure 3.
Automatic data processing increases efficiency
One of the major reasons why TEMS Discovery Device is so powerful and yet so easy to use is that the processing of data is fast and eff icient, due to the following features:
22
•
Handling of large volumes of data with low memory demand
•
Multithread, background data processing, while additional logfiles are being processed simultaneously
•
Distributed computing with automatic task dispatcher and load balancing
•
Easy and flexible configuration
•
Multiple projects can be processed in parallel
•
Options for selective data import
•
Flexible processing, where the user selects IEs of interest and whether to perform geolocation binning directly or later on
•
Possibility to adjust antenna gain during import
•
Other valuable features: NT12-3246, 1.0,5/13/2013
Smart merge of “fragmented” files
Group attribute editing during import
Indoor positioning of TEMS Pocket master-slave data
•
Automatic creation of multiple projects and data sets according to the user’s configuration
•
Automatic creation of KPI plots and reports
•
Automatic email notifications to multiple recipients
•
Automatic rule-based device attribute assignment
NT12-3246, 1.0, 5/13/2013
23
3.1.5
Versatil e Data Binni ng
The binning of data directly affects the KPI statistics as well as analysis of t he data.
Figure 4.
Data binning options
For utmost flexibility, there are several options available for data binning as shown below: •
Time binning during data import •
Frame level resolution
•
Smart selection
•
24
No binning for event-triggered messages
Binning for periodic messages
Geo-binning •
Distance binning
•
Grid binning
•
Per-region mixed resolution (for example, fine resolution in dense urban areas and coarse resolution in rural areas)
•
Holes can be defined in regions, for additional binning (and filtering) options
NT12-3246, 1.0,5/13/2013
3.1.6
Powerful Data Filtering
In order to find specific information among the collected data, no matter how well organized it is, you need a filtering function that assists you in this complex task.
Figure 5.
Efficient filtering of data
You have several filtering options that, whether used individually or combined, bring out the wanted information. Those filtering options are: •
Geographical regions
•
Network sector groups
•
User-defined metric-based conditions
•
User-defined problem set
•
Data collection date
•
Data processing date
•
User-defined event set
3.1.7
Diagnostics
Diagnostics (intelligent rule-based analysis) is a supremely powerful feature that will help you to pinpoint existing or potential problem areas that are often difficult and tedious to locate manually. The diagnostics are designed to reveal weaknesses related to cell configuration, tuning and optimization, accessibility, retainability, and integrity. Diagnostics are also used for classification of problem events like drop, block, etc. Examples of diagnostics included in T EMS Discovery Device •
Speech quality due to radio or core network issues
•
Low PESQ categorization on WCDMA (due to missing neighbor, pilot pollution, etc.)
•
Dropped call categorization for GSM and WCDMA
•
Dropped call diagnostics based on 3GPP recommendations, indicating radio link failure caused by too-early handover or by handover to the wrong cell
NT12-3246, 1.0, 5/13/2013
25
•
3.1.8
WCDMA Rooth analysis like “over shooter,” “swapped feeder” and “high latency”
Extensive Data Sharing Acro ss the Organizatio n
The sharing of processed data across the organization is handled via a designated public folder. TEMS Discovery Device provides: •
One-click publishing (upload) and data access (download)
•
Remote collaboration via peer-to-peer data sharing
•
Instant packaging and unpackaging of documents, projects, data sets, GIS data, and network configuration data, for effortless data sharing
•
A broad spectrum of configurations
Figure 6. TEMS Discovery Device document and configuration sharing across the organization. Contents of redcolored configurations can be further set to read-only or hidden for intellectual property rights (IPR) protection
26
NT12-3246, 1.0,5/13/2013
3.2
Analysis Views
This section highlights some of the views that will assist you in analyzing your network. The intention is not to provide a comprehensive description of all details but to give you a taste of the capabilities of TEMS Discovery Device.
3.2.1
Map View
The Map View is a multilayer display that can show multiple data sets, multiple cell configurations, and multiple GIS in the same view. To display data in the Map View, you simply drag the data object from the Data Explorer and drop it into the Map View.
Figure 7. Map View presenting multiple types of data (drive tests, GIS, indoor floor print, cell configuration) in multiple synchronized or nonsynchronized subviews, multimetrics displayed with offset, and floating legends
TEMS Discovery Device supports terrain elevation data, raster image data, vector files as well as Google or Bing for online maps. You can download free high-resolution aerial images and terrain elevation data directly from several GIS servers worldwide. Multiple synchronized subviews can easily be created for extensive geographical comparison and analysis.
NT12-3246, 1.0, 5/13/2013
27
Cell sites can then be plotted on the map. Cell names, identities, or any other labels can be presented next to the cell site symbol. Clicking a site displays information about it.
Figure 8.
Indoor drive test data can also be displayed with high-resolution satellite images as background
Here are some of the useful functions of the Map View: •
Spider movement too l: Displays ray lines that link the data point to the appropriate sector for serving and neighboring sites.
•
Sector coverage tool: Makes it possible to click on a sector to view its coverage.
•
IntelliSense to ol: Displays the information of a data object in a tool tip while moving the mouse over that data object.
•
Neighbor list IntelliSense tool: Displays ray lines that link to neighboring sectors, when moving the mouse over a sector.
•
Anten na p att ern vi ewer to ol: Makes it possible to click on a sector to view its antenna pattern.
•
Terrain path prof ile tool: Displays the terrain path profile when clicking and holding to draw a path.
In addition, the Map View display can be captured as an image file or be exported as a TIFF file or GIS package. You can also generate a PDF file or print the Map View display.
28
NT12-3246, 1.0,5/13/2013
3.2.2
Time-seri es Chart View
The Time-series Chart displays how the values of radio parameters evolve over time. Several parameters can be plotted in the same chart to enable quick inspection of correlation. Important time chart features include: •
Zooming and panning
•
Events shown
•
Multiple (up to 6 x 5) synchronized subviews in each chart
Figure 9. Time-series Chart displaying multiple metrics and events. Coloring indicates changes in active set membership.
•
Color coding of the metrics is displayed
•
The user can place a label with user-defined text in the chart
•
The Time-series Chart display can be printed and saved as an image file
NT12-3246, 1.0, 5/13/2013
29
3.2.3
Message View
The Message View contains two panels. The left-hand panel is a spreadsheet that lists the messages in time sequence, and the right-hand panel displays detailed information of the selected message at the left.
Figure 10.
Message View listing filtered messages and detailed information
In the Message View, you can: •
Open a Layer 3 IE explorer.
•
Decide on the most interesting information to display in the KeyInfo column.
•
Apply suitable colors to your messages, for easier viewing.
•
Filter the messages:
•
30
–
By mobile ID
–
By type of information
–
By selected message
–
By KeyInfo
Export the messages to a text file.
NT12-3246, 1.0,5/13/2013
3.2.4
Table View
Table View provides a tabular display of multiple metrics and events, and the data can be exported to Excel or MapInfo MID/MIF.
Figure 11.
Table View metric presentation
The Table View can also display a statistical report of the metrics.
Figure 12.
Table View statistical presentation
NT12-3246, 1.0, 5/13/2013
31
3.2.5
Point Details View
The Point Details View provides a convenient overview of detailed information from a particular time or location. By moving the cursor into the Map View and Time Chart, or by changing the row selection in the spreadsheet of the Message View and Table View, the detailed information will be displayed as shown below.
Figure 13.
The Point Details View displays detailed information about a specific measurement sample or message
You control what to display by selecting a specific user-configurable metric group from the configuration combo box. You can also edit or sort the displayed metric group. The Point Details View can also be displayed in the Map View as tool tip information.
Figure 14.
32
The tool tip displays detailed information about a specific measurement
NT12-3246, 1.0,5/13/2013
3.2.6
Inst ant Chart View
The Instant Chart View is a user-configurable view for graphical display of a set of array data. Features include: •
Multiple configurations
•
Instant bar chart view with optional Table View
•
Multiple chart space and multiple metrics
•
Fixed or metric-based coloring
Examples of usage: •
Scanner or phone data: Ec/Io and RSCP for all pilots on one or multiple UARFCNs
•
Transport channel information: Configuration, state, and throughput of concurrent channels
•
Adjacent channel analysis: Graphic visualization of the channel strength of adjacent channels
Figure 15.
Instant Chart View
NT12-3246, 1.0, 5/13/2013
33
3.2.7
Metri c Correlation View
Metric correlation enables the indication of a linear/nonlinear relationship between two metrics. You simply drag a metric data object from the Data Explorer and drop it into the Metric Correlation View, then drag another metric data object and drop it into the same view. The relationship between these two metrics is then established with the least squares fitting mathematical procedure.
Figure 16.
3.2.8
Metric Correlation View showing relation between metrics, multiple comparison
Problem Summar y View
This view summarizes device problems based on predefined or user-configurable problem sets (dropped calls, handover failures, etc.). You drag and drop devices into the view and if a device has problems, its background color will change from white to orange. You can choose to display all devices or only those with problems. You can view the details of a problem for a particular device or analyze the device itself. All problem-related information can be saved to Excel. From the Problem Summary View you can open the problem file with an analysis set designed to evaluate the specific problem at hand.
Figure 17.
34
Problem Summary View enabling easy analysis of devices with problems
NT12-3246, 1.0,5/13/2013
3.2.9
Hist ogr am View
The Histogram View is for graphical display of metric data showing the proportion of data that falls into each specific plot band. The graphical display of metric data can be shown as a bar graph, a 2D pie chart, or a 3D pie chart. All options can be freely converted from one to the other.
Figure 18.
The Histogram View displaying metric data in various charts
NT12-3246, 1.0, 5/13/2013
35
3.2.10
Multid imensi on Statisti c View
Multidimension Statistic View displays on-demand statistical data for multiple metrics in multiple user-selected dimensions. The user can filter data by using the built-in dimensions device attributes, time and date, UDR, cell configuration, or the user can define a new dimension from any metric by dragging and dropping the metric. The Multidimension Statistic View supports different statistical aggregation methods including mean, max, min, count, standard deviation, etc.
Figure 19.
Multidimension Statistic View displaying metric data
The Multidimension Statistic View also provides a chart presentation of the selected data in the table.
Figure 20.
Multidimension view chart presentation
To drill down to the details behind the statistical data, you can click on a cell in the grid and a list of files will be generated in the spreadsheet. You can save the list to file, create a composite data set from the list, or generate a report from the list. All data can be exported to external files. 36
NT12-3246, 1.0,5/13/2013
3.2.11
Sector Statisti c View
The Sector Statistic View displays a metric per sector binning; its functions are similar to those of the Table View. To display data in the Sector Statistic View, drag the metric data object from the Data Explorer and drop it into the Sector Statistic View.
Figure 21.
Sector Statistic View
NT12-3246, 1.0, 5/13/2013
37
3.3
Script ing and Report ing
3.3.1
Script Bui lder
TEMS Discovery Device provides an easy-to-use scripting capability with the built-in Script Builder. With the Script Builder, new metrics or events can be defined by combining already defined metrics and events. With the Script Builder you can define: •
New metrics , either based on all built-in metrics or on those extracted from any Layer 3 message. One example of a new metric would be mean signal strength three seconds before a handover.
•
New event s, with combinations of defined events, metric thresholds, or Layer 3 messages. An example of a new event would be handover failure due to bad coverage. In this case, the built-in dropped call event is the trigger event and if the signal strength three seconds before handover is below a defined threshold, then the new event is generated.
All new metrics and events defined will be available in all tools in the same way as the built-in metrics and events.
Figure 22. This script calculates the RRC setup time as the time between RRC Connection Request and RRC Connection Setup Complete
38
NT12-3246, 1.0,5/13/2013
3.3.2
Reporting
The Report View shows a particular mobile device or data set based on a predefined report template. Simply right-click on a mobile device or data set, select “Send to Report View,” and TEMS Discovery Device will generate a report based on the selected report template from the target data. You also have the option to define your own report template or to specify what you want to include in a report, with the help of the very flexible Report Builder. This eliminates the need to request customized report generation from other tool vendors, or to manipulate data manually. The Report Builder: •
Provides drag-and-drop access to all metrics and events – absolutely no SQL, Macro, or VB script knowledge required.
•
Can create very demanding and advanced report templates with complicated device filtering criteria.
•
Supports all frequently used statistical parameters.
•
Supports per-file and per-sector statistics.
•
Supports multidimension statistic reporting.
Figure 23.
With the Report Builder you can create your own templates and define how to display your data
Report types available with Report Builder: •
Single values of metrics with statistical parameters such as count, mean, min, max, linear average, standard deviations, variance, sum, first, duration, unique count, and more
•
Histogram charts with statistical parameters such as “% of total,” “% meeting condition,” count, unique count, linear average, mean, min, max, sum, first, duration, unique, and more
•
Trend charts with periodicity of hour, day, week, and month
•
Map Views with options for cell configuration, GIS data, and output area range
•
Sector-by-sector statistics
•
File-by-file statistics
NT12-3246, 1.0, 5/13/2013
39
•
Correlation statistics
3.3.3
Highly Auto matic Batch Printi ng
The batch printing feature is an easy way to generate PDF reports including user-defined maps, histograms, or time chart configurations. With this useful function you can: •
Select any configuration of metrics for Map View display or for a specific chart type.
•
Apply any configuration to any specific mobile device.
•
Use an unlimited number of mobile/configuration pairs.
•
Send your output to an electronic *.pdf file format, or to a regular printer.
Figure 24.
40
Automatic batch printing
NT12-3246, 1.0,5/13/2013
4
TEMS Discovery Device: Drilling Down to Measurement Data
TEMS Discovery Device is designed for in-depth study of your measurement data. It gives fast and full access to already processed data. A generous set of data presentation views helps you visualize the quality and performance of the network. TEMS Discovery Device uses a highperformance geographic information system (GIS), supporting approximately 100 different map formats. TEMS Discovery Device uses synchronizable views such as maps, time charts, messages, tables, and point details to display data collected at the same time (for drive test data playback). There are also data summary views such as histograms, metric correlation, reports, batch PDF views, and problem summary views to present statistic data in various formats. The Problem Summary View, for example, provides an easy way to pinpoint problems and drill down among user-configurable analysis sets, to find the cause. Some usage examples are found in section 4.2, “Further Examples of How to Use TEMS Discovery Device. ”
La er 3 messa e listin
Figure 25.
4.1
TEMS Discovery Device user interface
Contents and Characterist ics
All of the data in TEMS Discovery Device is well organized, and, unlike competing tools where you need to load raw log data in every new session, TEMS Discovery Device loads the data once and saves the processed data permanently until removed. Several projects may be active at the same time. Each project has its own workspace where all views belonging to the project are kept together. This coherence makes it very easy to work with several projects without losing track of what views belong together. View sizes can be freely adjusted. All views in a project are synchronized. Selecting a new item in one project view automatically highlights the corresponding item in all other views. NT12-3246, 1.0, 5/13/2013
41
A data set is created by importing one or several raw drive test files. All of the processed data are organized according to certain attributes, including the original file names, device names, mobile IDs, labels, etc. Processed data from one or more data sets of a project can be logically combined into composite data sets. A typical practice is to group the processed data by one attribute, such as mobile IDs or functional labels (long call, short call, PS call, etc.). An analysis set is a group of view layouts that includes precise configuration settings describing the specific names of the metrics to be displayed in a given view. You can send a whole set of metrics defined in an analysis set from a selected data source with a single click.
4.2
Further Examples of How to Use TEMS Discovery Device
The illustrations shown in section 4 mainly serve to support the description of the user interface components. This section provides further examples of data presentations and analysis.
4.2.1
Dropped Call Analysi s
Figure 26. In this example, the reason behind a dropped call is analyzed. It appears that the SIR target cannot be reached because of weak signal power. With the help of Google Maps, the user can conclude that the call was dropped inside a building.
42
NT12-3246, 1.0,5/13/2013
4.2.2
Anal yzing TEMS Pocket Indoo r Measurement
TEMS Discovery Device has a number of features that make the analysis of TEMS Pocket indoor measurements simpler and more efficient. TEMS Pocket logfiles including an indoor map can be imported directly into TEMS Discovery Device and displayed in the Map View with the indoor map as background. To get a complete picture of indoor and outdoor measurements, TEMS Discovery Device provides an easy way of geopositioning the data, as described in section 4.2.2.1. To make indoor data collection efficient, multiple TEMS Pocket units can be used in parallel. Employing one unit as the master, the user collects data and sets the pinpoints. The slave TEMS Pocket will only run test scripts and collect data, so the logfiles from the master device will include measurement data, map image, and pinpoints, and the logfiles from the slave device will include measurement data only. When the data is imported into TEMS Discovery Device, all logfiles will be positioned automatically as the master device (see section 4.2.2.2).
4.2.2.1
Positi onin g of Indoor Measurements
Figure 27. Indoor measurements from TEMS Pocket, for example, can be positioned within the building where the measurements are performed. The TEMS Pocket *.zip file containing the indoor measurements and the floor plan is imported as a regular drive test data file. When any data is dragged and dropped into the Map View, the floor plan appears with the selected data samples plotted. To position these measurements in relation to the actual building, you right-click the floor plan in the explorer and GIS/coverage map tab and select “Floor Print Rectifier.” Then you simply mark the corners of the floor plan and the corresponding corners of the building, and the positioning is done. The result is displayed in the next figure. NT12-3246, 1.0, 5/13/2013
43
Positioning of indoor measurements is done and the result is shown below.
Figure 28. After geo-rectification, the indoor measurement data can be displayed like normal outdoor drive test data along with other GIS and cell configuration data
44
NT12-3246, 1.0,5/13/2013
4.2.2.2
Import of TEMS Pocket Multidevice Measur ements (Master-Slave)
To import master and slave indoor files into TEMS Discovery Device, select the master and slave logfiles and enable the “All TEMS Indoor files share the same floor print and way points” option.
Figure 29.
Import of indoor master-slave data
By using automatic data processing, TEMS Pocket master-slave logfiles can be imported and positioned automatically.
NT12-3246, 1.0, 5/13/2013
45
4.2.3
Sector -Based Statistic s
Statistics can be generated and displayed per sector. Functions include: •
One-click generation of multiple KPIs on a sector-by-sector basis
•
Color coding of sector icons with drive test KPIs for instantaneous, graphical visualization of network performance
•
Any combination of two arbitrary KPIs can be presented simultaneously
Figure 30.
46
Statistics easily generated per sector, clearly displaying the selected KPIs
NT12-3246, 1.0,5/13/2013
5
Appendices
5.1
Support ed Operating Systems
Function / Feature set
Replay
Standard
Professional
Replay
Standard *
Profess ion al
Microsoft Windows XP® (SP 3) Microsoft Windows Vista® (SP 2) Microsoft Windows 7® (32 bit) Microsoft Windows 7 (64 bit) Microsoft Windows Server® 2005 Microsoft Windows Server 2008 R2
5.2
Logf ile Support
Funct ion / Featur e set TEMS Investigation 8.0 – 13.1 TEMS Pocket 7.3 – 11.2 TEMS™ Automatic 7.2 – 9.0 TEMS Symphony (MDFS 6.1) TEMS Monitor Master (MDFS 6.1) Nemo nmf & Legacy .dt*, fs* files File format version 2.0.8 JDSU .aod & Legacy .sd5 files E6474A 16.0 LG LTE DM (LLDM), Version K ZK Celltest (Log File Format V6.27) Call trace (Ericsson UETR) W11A IP trace (libpcap) Flexible text file import to User-defined Metric Groups Custom data import by plug-in API
*TEMS Discovery Device – Standard feature set (bundled with TEMS Investigation) supports logfiles collected with TEMS Investigation.
5.3
Support ed Techno logi es
Function / Feature set
Replay
Standard
Professi onal
GSM/GPRS/EGPRS WCDMA/HSPA/HSPA+ CDMA (IS-95/CDMA 2000 1x/EVDO rev 0, rev A & rev B)
NT12-3246, 1.0, 5/13/2013
47
TD-SCDMA FDD-LTE TD-LTE WiMAX
5.4 Function / Feature set
Data Processing Replay
Standard
Professio nal
Versatile data binning Powerful data filtering Composite data set Smart merge of TEMS Automatic logfiles Geo-rectification of indoor logfiles Geopositioning of TEMS Pocket slave device Automatic data processing Measurement database Multidimensional Statistical Database Logfile Storage Database Parallel logfile data processing (up to 4 logfiles in parallel) Parallel logfile data processing (4 up to 64 logfiles in parallel)
5.5
Cell Configu ration Support
Function / Feature set
Replay
Standard
Professio nal
Ascom TEMS .XML Ascom TEMS .cel Cell file export to TEMS XML format Cell configuration multiversion support ASSET XML Actix Celref Atoll XML. Import of Ericsson cell file data (Bulk CM) Import and export of network configuration data with flexible parameter mapping Interactive neighbor list editing
48
NT12-3246, 1.0,5/13/2013
5.6
Hando ver Matr ix
Function / Feature set
Replay
Standard
Professi onal
Replay
Standard
Professi onal
Huawei (GSM, WCDMA) Alcatel-Lucent (WCDMA)
5.7
GIS
Function / Feature set Supports more than 110 different GIS data formats, including many free or low-cost high-resolution terrain data, satellite images, and vector data GIS data: terrain elevation, clutter, raster image, vector data Automatic merging and reprojection of data from different map sources Directly import GIS data from multiple free online GIS data sources Integrated Google Earth /map/satellite/terrain Integrated Microsoft Bing Map /map/satellite/terrain 3D Map View Terrain profile tool
5.8
Reporting
Function / Feature set
Replay
Standard
Profession al
RAN Report – GSM Data Only RAN Report – GSM Voice and Data RAN Report – GSM Voice Only RAN Report – WCDMA Data Only RAN Report – WCDMA Voice and Data RAN Report – WCDMA Voice Only Acceptance Report – 1xEV-DO Acceptance Report – CDMA2000 Acceptance Report – CDMA2000_V2.0 Acceptance Report – GSM Acceptance Report – LTE Acceptance Report – TD-SCDMA Acceptance Report – WCDMA QVoice ETSI KPI FTP Download QVoice ETSI KPI FTP Upload QVoice ETSI KPI HTTP Upload NT12-3246, 1.0, 5/13/2013
49
QVoice ETSI KPI Web Browsing (HTTP) QVoice_Management_Report TEMS_Data_Service_KPI_Report Sample Report - 1xEV-DO Sample Report – Benchmark Sample Report - Benchmark-2 Sample Report – CDMA Sample Report - GSM Voice Sample Report - GSM Voice (Nemo) Sample Report - WCDMA CS Call Report template builder Report template export Report template import
5.9
Analysis Views
Function / Feature set
Replay
Standard
Professional
Map View Table View Message Summary and Detailed View Time-series XY Chart Instant Chart View Histogram View Point Details View Message Flow Diagram Metric Correlation View Multidimension Statistic View Delta Metrics Sector Statistics View Problem Summary View Troubleshooting Workflow Google Map Microsoft Bing Map
5.10
Map Suppo rt
Function / Feature set
Replay
Standard
Professio nal
Metric and event presentation Cell site linking with drive test data point Interactive linking between cell
50
NT12-3246, 1.0,5/13/2013
