Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Semelhante a 2012 july mil soft_ie_capabilities__iic_solutions-general-eng
Semelhante a 2012 july mil soft_ie_capabilities__iic_solutions-general-eng (20)
Mais de milsoftSDC
Mais de milsoftSDC (17)
Último
Último (20)
2012 july mil soft_ie_capabilities__iic_solutions-general-eng
- 1. MilSOFT Network Centric Imagery Intelligence MilSOFT UNCLASSIFIED 1/33
- 2. Contents MilSOFT UAV Systems / Imagery Intel Specific Projects Turkish UAV Programme - TIES and RVT Turkish UAV Programme - GCSMS GOKHAN Net Centric Intelligence Solutions MilSOFT General Image Processing Capabilities Image/Video Processing Capabilities Image Exploitation and Photogrammetry Capabilities Image Annotation and Finding Management Intelligence Request and Report Management Data Reception – Streaming – Visualization – Storage Management MilSOFT UNCLASSIFIED 2/33
- 3. UAV Systems and MilSOFT’s Contribution UAV GDT RVT GCS TIES SGT MilSOFT UNCLASSIFIED 3/33
- 4. Turkish UAV Programme - Phase 1 (HERON) – TIES and RVT MilSOFT UNCLASSIFIED 4/33
- 5. Turkish UAV Programme - Phase 1 – TIES Interior and Exterior Views Transportable Image Exploitation System Interior Design: MIL-STD -1472 Human Engineering Standard MilSOFT UNCLASSIFIED 5/33
- 6. Turkish UAV Programme - Phase 1 – RVT Segment Remote Video Terminal Main Purpose: Reconnaissance Forward Area Surveillance Main Functionality: Receive and Display UAV Platform & Sensor (Video) Data UAV Manual / Automatic Tracking MilSOFT UNCLASSIFIED 6/33
- 7. Image Exploitation System is Compliant to NATO Standards •SAR Data Reception Based on STANAG 7023 Air Reconnaissance Primary Imagery Data Standard •GMTI Data Reception Based on NATO EX (NC3A-TN-732) Format •STANAG 4607-ready NATO Ground Moving Target Indicator Format (GMTIF) •STANAG 4545 NATO Secondary Imagery Format (NSIF) •EO/IR Video Reception Based on MPEG4 and STANAG 4609 NATO Digital Motion Imagery Standard •STANAG 3277 Compliant Priority Intelligence Request Preparation and Management •Reporting the Findings as per STANAG 3377 MilSOFT UNCLASSIFIED 7/33
- 8. Turkish UAV Programme - Phase 2 (ANKA) – GCS-MS UAV Ground Control Mission Systems Payload Control Payload Data Record & Replay GDT Data & Communication Management RVT Health Management Mission Planning GCS TIES SGT MilSOFT UNCLASSIFIED 8/33
- 9. TUAV Programme - Phase 2 – GCSMS Ground Control Station Mission Systems •Data Receiving •Communication System •Payload Control Software •Payload Data Record and Replay MilSOFT UNCLASSIFIED 9/33
- 10. STANAG and STANDARTS • STANAG 4586 Standard Interfaces of UAV Control Systems (UCS) for NATO UAV Interoperability • STANAG 4607 NATO Ground Moving Target Indicator Format (NGMTIF) • STANAG 4609 NATO Digital Motion Imagery Format • STANAG 7023 Air Reconnaissance Primary Imagery Standard • STANAG 4591 THE 600, 1200 AND 2400 BIT/S NATO INTEROPERABLE NARROW BAND VOICE CODER • STANAG 5500 NATO Message Text Formatting System (Formats) ADatP-3 Build 11 MilSOFT UNCLASSIFIED 10/33
- 11. GOKHAN (Image Exploitation and Target Analysis System) GOKHAN (Image Exploitation and Target Analysis System) is an ongoing State supported Research and Development Project. Main purpose is: • to continuously incorporate academic enhancements into our existing image processing capabilities, • Provide an add-on to Image Exploitation Systems, • Study a net-centric architecture for image intelligence systems. MilSOFT UNCLASSIFIED 11/33
- 12. GOKHAN (Image Exploitation and Target Analysis System) Architectural Components Data sources Target detection/identification/recognition (EO, IR, SAR) Motion Imagery -UAV imagery Exploitation -CCTV Cameras Tank , T 72 ZPT , BMP 2 Still Imagery Satellite & UAV ZPT, BTR 60 ZPT, BMP 2 originated data ZPT,BMP 2 ZPT ,BTR 70 TIES Event/Situation analysis GIAS Services Discovery and Access Imagery Repository Metadata Store MilSOFT UNCLASSIFIED 12/33
- 13. GOKHAN (Image Exploitation and Target Analysis System) GIS Based Applications Mobile access Central Base Geo-spatial Imagery Image Library Map Services Access Services OGC-WFS STANAG-4559 OGC-WMS, ISO 19128 Geospatial Store Geospatial Store MilSOFT UNCLASSIFIED 13/33
- 14. MilSOFT Net Centric Air Intelligence Solutions for all Levels Front Line Intel Request Units l ve l l Le ve Le Conventional na Intelligence Cycle l t io ca era cti Ground Segments Op Intel Report Ta Live Data and Intel Available for Field Local Image Exploitation Station l ve Le Multiple Data Fused g ic Live Data and Intel ate Wired/Wireless/SATCOM/TDL Available for Headquarters r St Military Networks Image Library Imagery Intellegence Center (IIC) MilSOFT UNCLASSIFIED 14/33
- 15. Operational Advantages Highlights for Central Image Intelligence #1 • Net centric infrastructure: • Supports All Levels of Air Intelligence (Strategic, Operative and Tactical), (seamless integration of all level systems) • NetCentric RVT Capability, (No need to have aircraft connectivity) • Continuous Access to Intelligence Enterprise, (Information is centrally located; rapid, easy and continuous access to data) • Secure Dissemination of Information, • Streaming Media Services, (Live streaming video is available to decision makers to rapid and fast reaction and for better situational awareness) • Wide range of input formats: • Supports wide range of data sources varying from UAV’s, to Recce A/C, to Satellite Pics, • Fusion of multiple sensor data, (Since many sources of data collected within the same database; data fusion is capability is available to achieve enhanced information ) • Multisensor, single and multiple image exploitation, (one environment, multi sensor exploitation; one environment, multi site’s data exploitation ) MilSOFT UNCLASSIFIED 15/33
- 16. Operational Advantages Highlights for Central Image Intelligence #2 • Increased Situational Awareness: • Current Data, (Live access to current data for better situational awareness) • Historical Data,(Rapid access to historical data to observe the trend.) • Integrated GIS Support, (Fully integrated GIS tools to analyze the data. Measure distances between the objects, get the coordinates of images and findings, align the data and findings with a map for increased situational awareness ) • Supports all phases of Intelligence Cycle: • Intelligence Processing from Request to Reporting and Information Dissemination, (Integrated solution to provide the user with Intel Request Mngmnt, Intel Collection Mngmnt, Intel Resource Mngmnt, Intel Data Mngmtn for Strategic Level Intel Activities) MilSOFT UNCLASSIFIED 16/33
- 17. Operational Advantages Highlights for Central Image Intelligence #3 • State-of-the art Technology: • Web based solution, HTML 5 supported GIS, (Accessible from a wide range of devices/locations, also platform independent application) • Multi level recording: • Integrated data storage capability, (data storage solution is fully integrated with intelligence solution, multi level intelligence specific data storage needs are fully met ) • Sophisticated data storage and data aging policy, (special data aging policy for less used intelligence products; also special data archiving policy specific to intelligence needs. Data access to archived data is available from the integrated intelligence solution offered) MilSOFT UNCLASSIFIED 17/33
- 18. Operational Advantages Highlights for Central Image Intelligence #3 • Collecting data received from different sensors and systems in a central location allows generation of most confident and correct intelligence reports through validation and cross checks. – Reliability • Providing information integrity by combining all data and reports in a center and maintaining a centralized database. – Information Fusion • Providing a single data dissemination point, which allows controlled dissemination of correct and current intelligence to relevant parties in necessary detail. – Security • A centralized architecture allows accelerated approval and decision takign processes. – Efficiency MilSOFT UNCLASSIFIED 18/33
- 19. Contents MilSOFT UAV Systems / Imagery Intel Specific Projects TUAV Programme - TIES and RVT TUAV Programme - GCSMS GOKHAN Net Centric Intelligence Solutions MilSOFT General Image Processing Capabilities Image/Video Processing Capabilities Image Exploitation and Photogrammetry Capabilities Image Annotation and Finding Management Intelligence Request and Report Management Data Reception – Streaming – Visualization – Storage Management MilSOFT UNCLASSIFIED 19/33
- 20. MilSOFT’s General Image/Video Processing Capabilities • Target Detection/Tracking Capabilities (examples provided within) • Moving Target Detection on EO/IR Video Streams • Target Tracking on EO/IR Video Streams • Hot Spot Detection on IR Video and IR Still Images • Fixed Target Indication and Cluster Detection on SAR Images • Moving Target Visualization and Tracking on GMTI • Change Detection Capabilities (examples provided within) • Change Detection on SAR Images • Change Detection on Video Streams • Change Detection on EO/IR Still Images • Detection of Unattended Objects or Removed Objects on Video Streams • Analysis Capabilities in brief (examples provided within) • Road-Bridge-Building Detection • Detection of Urbanization • Smoke/Fire Detection • Runway and Airport Detection • Area Intrusion Detection MilSOFT UNCLASSIFIED 20/33
- 21. Target Detection/Tracking Capabilities - IR Video Hot Spot Detection and IR Image Hot Spot and Cluster Detection MilSOFT UNCLASSIFIED 21/33
- 22. Target Detection/Tracking Capabilities – Change Detection Thresholding - and analysis Disappeared Objects Highlighted Automatically MilSOFT UNCLASSIFIED 22/33
- 23. Analysis Capabilities – Building Detection Damage Assessment MilSOFT UNCLASSIFIED 23/33
- 24. MilSOFT’s Photogrammetry/Exploitation Capabilities • Photogrammetry Capabilities in brief (examples provided within) • Video / Image Mosaicking • Video / Image Geo-Registration • From Image to Image • By using GCP’s • Image Overlapping • Digital Elevation Model (DEM) Generation using overlapping images • Image rectification, to plane or to DEM (ortho rectification) • Stereo image generation and visualization • 3D scene generation using DEM or related ortho-rectified imagery • Image matching, semi automatic and automatic tie point generation • Basic Exploitation Capabilities in brief (examples provided within) • Image Enhancement (Noise Filtering, Jitter Elimination, Pseudocoloring, Image Edge Sharpening, etc.) • SAR Speckle Reduction • EO/IR Super Resolution • SAR Super Resolution • Histogram Processing MilSOFT UNCLASSIFIED 24/33
- 25. Photogrammetry Capabilities – Video Mosaicking Homography based matching and phase correlation MilSOFT UNCLASSIFIED 25/33
- 26. Photogrammetry Capabilities – Image Mosaicking – Overlapped Images MilSOFT UNCLASSIFIED 26/33
- 27. Exploitation Capabilities – Histogram Equalization Better images achieved to analyse the details MilSOFT UNCLASSIFIED 27/33
- 28. Photogrammetry Capabilities Image matching, semi automatic and automatic tie point generation Image mosaicking Digital Elevation Model (DEM) generation using overlapping images Image rectification, to the plane or to the DEM (ortho-rectification) Stereo image generation and visualisation 3D scene generation using DEM and related ortho-rectified imagery 3-D Scene Generation Mosaicking DEM Stereo Image Extraction MilSOFT UNCLASSIFIED 28/33
- 29. MilSOFT’s General Intelligence Management Capabilities • Image Annotation and Finding Management (examples provided within) • Target/Finding Management as per STANAG 3596 • Target/Finding History Tracking • Image Annotation Management and Symbology • Distance, Area Measurement Tools • Object Counting and Reporting • Intelligence Request and Reporting Management (examples provided within) • STANAG 3277 Compliant Priority Intelligence Request Preparation and Management • Reporting the Findings as per STANAG 3377 • Report Dissemination through commercial standard protocols • Customizable Report Layouts MilSOFT UNCLASSIFIED 29/33
- 30. TIES Functionality – Exploitation Officer Viewer Screen Finding Management Image Annotation Symbology Distance, Area Measurement Tools Object Counting, Reporting MilSOFT UNCLASSIFIED 30/33
- 31. MilSOFT’s Visual Data Handling Capabilities • Data Reception – Streaming Management • SAR Data Reception Based on STANAG 7023 Air Reconnaissance Primary Imagery Data Standard • GMTI Data Reception Based on NATO EX (NC3A-TN-732) Format • STANAG 4607-ready NATO Ground Moving Target Indicator Format (GMTIF) • STANAG 4545 NATO Secondary Imagery Format (NSIF) • EO/IR Video Reception Based on MPEG4 and STANAG 4609 NATO Digital Motion Imagery Standard • Publish-subscribe (DDS) based Video Streaming MPEG-2 MPEG-4 over transport stream • DDS based SAR & GMTI Streaming • Data Visualization (examples provided within) • Live / Raw / Recorded EO/IR Video & Telemetry Screening • Live / Raw / Recorded EO/IR Video & Telemetry Visualization on Map • Live / Raw / Recorded SAR Screening and Visualization on Map • Live / Raw / Recorded GMTI Screening and Visualization on Map MilSOFT UNCLASSIFIED 31/33
- 32. Data Visualization – UAV Monitoring w/ Overlayed Telemetry UAV UAV Observing area MilSOFT UNCLASSIFIED 32/33
- 33. Data Visualization – Viewers MilSOFT UNCLASSIFIED 33/33
Notas do Editor
- MilSOFT’s Network Centric Image Intelligence Capabilities and Solutions will be explained in two parts. In the first part, MilSOFT’s contribution to UAV Programmes and a network-centric imagery intelligence solutions will be explained . Then, a brief information on general image processing capabilities to form the solutions will be provided.
- In the slide there are main components of a typical UAV system. MilSOFT, in different projects, have provided solutions to highlighted components of a typical UAV System. Details are provided in the upcoming slides.
- In Turkish UAV Programme - Phase 1 (HERON) , MilSOFT designed and developed Transportable Image Exploitation Station (TIES) and Remote Video Terminal (RVT). These components are deployed and operational on site. Purpose of operators located in TIES are receive the sensor data, make detailed analysis on the data recevied and create imagery intelligence reports. Those reports are send to requesters online through secure military lines. RVT on the other hand is used by forward observers in the field, It receives tha sensor data directly from the aircraft. Every component of RVT is rugged for harsh environment.
- In the slide you are seeing inner and outer views of TIES.
- In the slide you are seeing RVTs currently operated at the field. RVT receives and displays UAV Sensor (Video) Data. RVT has automatic aircraft tracking capability.
- Our Solutions are compliant to NATO STANAG’s and Standards This provides the end user with: Ease of Integration with legacy and modern systems Interoperability Extensibility
- In Turkish UAV Programme - Phase 2 (ANKA) – GCS-MS, apart from TIES and RVT, MilSOFT designed and developed the Mission Systems in the Ground Control Station. This project is in deployment phase to field. Ground Control Mission Systems is consisted of: Payload Control Payload Data Record & Replay Data & Communication Management Health Management Mission Planning
- In GCS-MS Data Reception is consisted of: SAR/ISAR data reception compliant with STANAG 7023 GMTI data reception compliant with NatoEX format EO/IR data reception compliant with STANAG 4609 Communication is consisted of: GCS and Ground Data Terminal (GDT) Communication GCS and TIES and other peripheral support systems Communication . Intercom and ATC Communication Payload Control and Data Record and Replay is consisted of: Payload (EO/IR, SAR/ISAR/MTI, Air Traffic Communication Radio (V/UHF) command, control and monitor automatically (in accordance with mission plan) or manually Interoperable with the installed payloads across the Level-3 of STANAG 4586
- Our Solutions are compliant to NATO STANAG’s and Standards This provides the end user with: Ease of Integration with legacy and modern systems Interoperability Extensibility
- This project is an R&D project focused on automatic target detection/recognition and behaviour analysis. Main purpose is: to continuously incorporate academic enhancements into our existing image processing capabilities, Provide an add-on to Image Exploitation Systems , Study a net-centric architecture for image intelligence systems.
- In this slide, architectural study view for GOKHAN Project is provided. Here, it is assumed that user has multiple data sources at the same time. Also user will need to have a high capacity image library to store the data and metadata in separate repositories. Details of this high capacity library is given in the next slide separatly. Also in this scenario exploitation results are disemminated through network centric approach. Results are made available and accesible to users located in a distance to the where the exploitation services are served.
- As mentioned in the previous slide, architectural study includes a high capacity imagery library. The imagery data stored in this library is made available to the relevant parties using secure and standards based interfaces. The library interface is NATO STANAG-4559 compliant. Maps stored in the center are also served in compliance with the OGC standards. All intelligence data is made available via HTML5 compliant web interfaces, which allows using mobile devices such as tablet PCs or smatphones to access the data.
- In this slide we shall go over a scenario: ------- Let’s consider the conventional operation of a UAV system. A troop requring intelligence submits an Intelligence Request or a Reconnaissance Request to be handled by that specific UAV fleet. A UAV is planned for the intelligence task, the received imagery is exploited and the resulting intelligence is disseminated to the related parties including the requesting troop. This is the conventional imagery intelligence approach. In the conventional imagery intelligence approach, the imagery data acquired during the mission is stored and managed in the ground system specific to the platform. Exploitation is also performed in ground systems specifically designed the platform. Dissemination of the data is very limited. Data dissemination is either totally offline or only part of the data is disseminated. In the conventional imagery intelligence approach, it is not possible to effectively integrate data acquired from multiple systems. In addition, it is not easy for troops in the field to access the platform data. Generally only live data is accessible, if the troop has the receiving equipment and RVT (Remote Video Terminal) compliant with the specific platform, and only while the platform is near enough. Apart from that, it is not possible for the troops to access previously recorded imagery or intelligence data, let alone accessing data from multiple platforms. In the network centric approach, the scenario explained for the classical approach is considered as the Operational Level. ----------------- Now, consider an Imagery Intelligence Center where live and offline data from multiple sources including UAVs, satellites, reconnaissance aircrafts, etc is collected. This center can have a high capacity, reliable and fast data storage combined with necessary services which acts as an imagery library. In this center, imagery from multiple sources can effectively be integrated and fused. This allows enhanced imagery intelligence due to access to imagery from many different sources. Additionally, it can be possible to detect higher level events, which cannot be perceived by looking at any available single imagery, by fusing and analyzing data from multiple sources. This center can also disseminate live and processed data to commanders at the head quarters. These capabilities are considered as Strategic Level. -------------------- Imagery Intelligence Center can also disseminate data to the troops in the field using a secure network infrastructure. In this approach, troops use a Network-Centric RVT rather than a classical RVT. A Network-Centric RVT uses standard secure network protocols to access live and processed IMINT data, which eliminates the use of platform specific receiving equipment totally. A single Network-Centric RVT allows the troops to access live imagery from many different imagery sources. In addition to live data, previously recorded data or the current intelligence picture of the battlefield can be accessed using a Network-Centric RVT. Network-Centric RVT and the services provided at the IIC for the proper operation of Network-Centric RVT are considered as the Tactical Level ----------------- The Network-Centric Imagery Intelligence Solution explained in this slide addresses the imagery intelligence in all levels: Tactical, Operational and Strategic.
- Detailed operational advantages for central image intelligence is highlighted in the slide.
- Detailed operational advantages for central image intelligence is highlighted in the slide.
- Detailed operational advantages for central image intelligence is highlighted in the slide.
- Detailed operational advantages for central image intelligence is highlighted in the slide.
- MilSOFT’s Network Centric Image Intelligence Capabilities and Solutions will be explained in two parts. In the first part, MilSOFT’s contribution to UAV Programmes and a network-centric imagery intelligence solutions will be explained . Then, a brief information on general image processing capabilities to form the solutions will be provided.
- In this slide, general image/vieo processing capabilities of MilSOFT are shown. MilSOFT has the following target detection tracking capabilities: Moving Target Detection on EO/IR Video Streams : This capability is generally used for detecting humans or vehicles moving in a region. Target Tracking on EO/IR Video Streams : This capability allows the operators to mark a target and track the target in the video as the mark is locked to the target (moves with the target). Hot Spot Detection on IR Video and IR Still Images : This capability allows detection of campfires and similar hot objects in IR image and videos. Fixed Target Indication and Cluster Detection on SAR Images : This capability allows detections of targets with a high RCS (radar cross section). Generally speaking this capability allows detection of military ground targets which are mostly metallic with high RCS. Moving Target Visualization and Tracking on GMTI : GMTI data usually includes plot-only data, this capaility allows generating track information from plots. Change Detection can be summaries as follows: Change Detection on SAR Images : Detection of changed image regions by automatically comparing two images acquired in different times (possibly from different angles) Change Detection on Video Streams Change Detection on EO/IR Still Images Detection of Unattended Objects or Removed Objects on Video Streams Analysis Capabilities in brief Road-Bridge-Building Detection Detection of Urbanization Smoke/Fire Detection Runway and Airport Detection Area Intrusion Detection
- Illustration of IR hot spot detection is provided in the slide.
- Left side: two images of the same area, taken in different times Right side: Regions containing differences are highlighted.
- This capability allows detection of buildings from images. The capability can also be used for damage assessment as the algorithm detects only undamaged buildings.
- In this slide, general image manipulation capabilities of MilSOFT are shown.
- The images in a video sequence are registered and a mosaic is generated while the video is playing. Example outputs are shown in the slide.
- A mosaic using multiple images of the same area.
- Histogram equalization enhances the visibility of images, by stretching the color/gray-level.
- Brief photogrammetry capabilities are shown in the slide.
- Brief image annotation capabilities are shown in the upper section of the slide. In the lower section brief intelligence request and reporting capabilities and compliant NATO STANAG’s are shown.
- Exploitation tools provide the operator to analyze and image together with the recent images of the same region along with the maps of the region. The operator is provided with a wide range of analysis tools including coordinate, distance, area and direction measurement tools. The operator can perform exploitation by using the annotation tools for graphically and textually annotating the imagery. In addition, findings (targets) can be managed in a standards compliant interface. The history of findings can be tracked. The operator can also anlyze the previously prepared reports for the same geographical region.
- Brief data reception capabilities and compliant NATO STANAG’s are shown in the upper section of the slide. In the lower section brief data visualization capabilities are shown.
- Using the telemetry data acquired together with the imagery data, the operators can monitor the current position of the UAV and the area currently observed.
- Specialized viewers are provided for the operators to display and analyze the following data: Video SAR imagery GMTI