Drone detection event-based cameras from Prophesee

Event-based cameras outperform frame-based approaches for many applications. We provided insight to the event-based paradigm in a recent blog. Or download our whitepaper on event-based sensing.

In this piece, we focus on drone detection, a task at which event-based imaging excels. For full-impact, please view the following in full-screen mode using the “four corners” button.

Find the drone – Event-based approach beats frame-based method – Courtesy scientific paper attribution

As discussed in the event-based paradigm introductions links above, frame-based approaches would struggle to track a drone moving in a visually complex environment (above left), having to parse for drone shapes and orientations, occlusions, etc., even when most of the imagery is static.

Meanwhile, as seen in the event-based video (above right), the new paradigm only looks for “what’s changed”, which amounts to showing “what’s moving?”. For drone detection, as well as other perimeter intrusion applications, vibration monitoring, etc., that’s ideal.

1stVision represents Prophesee’s event-based sensors and cameras, built on neuromorphic engineering principles inspired by human vision. Call us at 978-474-0044 to learn more or request a quote.

Contact us for a quote

For some applications, one only needs an event-based sensor – problem solved. For other applications, one might combine different imaging approaches. Consider the juxtaposition of three methods shown below:

Visible, polarization, and event-based approaches – Courtesy Prophesee and EOPTIC

The multimodal approach above is utilized in a proprietary system developed by EOPTIC, in which visible, polarization, and event-based sensors are integrated. For certain applications one may require the best of speed, detail, and situational awareness, for automated “confidence” and accuracy, for example.

Here’s another side-by-side video on drone detection and tracking:

Visible vs. (hybrid) event-based imaging – Courtesy Prophesee and NEUROBUS

The above-left video uses conventional frame-based imaging, where it’s pretty hard to see the drone until it rises above the trees. But the event-based approach used by Prophesee’s customer Neurobus, together with their own neuromorphic technologies, identifies the drone event amidst the trees – a level of early warning that could make all the difference.

By the numbers:

Enough with the videos – looks compelling but can you quantify Prophesee event-based sensors for me please?

Quantifying key attributes – Courtesy Prophesee

Ready to evaluate event-based vision in your application?

1stVision offers Prophesee Metavision® evaluation kits designed to help engineers and developers quickly assess event-based sensing for high-speed motion detection, drone tracking, robotics, and other dynamic vision applications. Each kit provides everything needed to get started with Prophesee’s Metavision technology, including hardware, software tools, and technical support from our experienced machine vision team. Request a quote to discuss kit availability, configuration options, and how we can help accelerate your proof-of-concept or system deployment.” – we can link that page with the kits. 

Technical note: The GenX320 Starter kit for Raspberry Pi 5” utilizes the Sony IMX636 sensor, expressly designed for event-based sensing.

Kit or camera? You choose.

The kits described and linked above are ideal for those pursuing embedded designs. If you prefer a full camera – still very compact at less than 5cm per side – and you want a USB3 interface – see IDS uEye event-based cameras. You’ve got options.

1st Vision’s sales engineers have over 100 years of combined experience to assist in your camera and components selection.  With a large portfolio of cameraslensescablesNIC cards and industrial computers, we can provide a full vision solution!

About you: We want to hear from you!  We’ve built our brand on our know-how and like to educate the marketplace on imaging technology topics…  What would you like to hear about?… Drop a line to info@1stvision.com with what topics you’d like to know more about.

AVT updates bring new Alvium features

Here are some cool new features. At least they’re cool if you already use AVT Alvium cameras and want to get even more out of them. Conversely the features may get your attention to give Alvium a look for your next application.

We call out five specific new features (or feature sets):

  • Liquid lens autofocus controls – great for logistics applications: fast focus change
  • Power saving standby mode – heat minimization for embedded designs
  • Improved recovery from over-temperature power savings mode – automated recovery
  • More GenICam features for V4L2 Video for Linux – great to have Linux options
  • Additional registers and controls – if some DRA is good, more is better

… especially for the Alvium camera families, including USB3 and MIPI CSI-2, and 1 GigE and 5 GigE models.

Alvium USB3, MIPI CSI-2, 1 GigE and 5 GigE compact and powerful cameras – Courtesy AVT – a TKH brand

Call us at 978-474-0044 to speak to one of our experienced sales engineers. Or tell us what you’d like to know more about – whether concepts, features, or pricing – and we’ll get back to you:

Click to contact
Give us some brief idea of your application and we will contact you to discuss camera options.

Liquid Lens Autofocus Controls

If you’re new to liquid lenses, see our prior blog for examples and an overview. Liquid lenses can change focus within milliseconds, far faster than mechanical apertures.

Below you can see the hardware configuration, which new new autofocus controls can utilize.

Courtesy AVT – a TKH Vision brand

So AVT provides the lens controlling capability on the camera side, and you can optionally connect a liquid lens if that would help your application. Naturally AVT Alvium cameras may also be used with conventional lenses, including S, CS, C, closed, open, and bare-board – range of options varies slightly by model. Please review when ordering or confer with us per adage “measure twice cut once”.

Power saving standby mode

There are at least to reasons why you might be interested in power savings. The layman’s view might be to preserve the environment or save on energy costs. But compact sensors and cameras don’t use a lot of power, often just +/- 1 watt. The primary motivator, for embedded systems designers, is to reduce heat, during periods when no imaging is required. That in turn enhances image quality and prolongs system life.

Power saving mode enabled vs. disabled – Courtesy AVT – a TKH Vision brand

Improved Recovery from over temperature mode

When the camera goes into over temperature mode, it automatically stops power draw as a self-protection mechanism. In firmware V13 this required a camera reboot to resume imaging. Now in V15 the camera resumes normal function without requiring reboot.

Improved recovery from over temperature mode – Courtesy AVT – a TKH Vision brand

(More) GenICam features for V4L2 Video for Linux

If you favor video for Linux (V4L2) drivers and APIs for your development and production controls, below see GenICam features now available to you.

Courtesy AVT – a TKH Vision brand

Additional Registers and Controls

In addition to all the registers previously available on Alvium’s MIPI CSI-2 cameras, below are a number of new registers, whose names suggest their meaning and use. One may control each feature through any of GenICam APIs, V4L2 Video for Linux, or by Direct Register Access (DRA) memory addressing. Whichever method you prefer.

New registers available for DRA – Courtesy AVT – a TKH Vision brand

Manuals for all AVT cameras and SDKs are downloadable, of course. Drill in on any feature or attribute of interest.

1st Vision’s sales engineers have over 100 years of combined experience to assist in your camera and components selection.  With a large portfolio of cameraslensescablesNIC cards and industrial computers, we can provide a full vision solution!

About you: We want to hear from you!  We’ve built our brand on our know-how and like to educate the marketplace on imaging technology topics…  What would you like to hear about?… Drop a line to info@1stvision.com with what topics you’d like to know more about.

JAI prism-based 5 GigE cameras for superior color

If monochrome sensors and methods aren’t enough for your application, a machine vision color camera may be needed. And if color is needed, is “good enough” from a single sensor with a Bayer filter all you need? Or do you need the precision of a prism-based 3 sensor camera, one for each of R, G, and B? See our whitepaper Considerations for Color Machine Vision Cameras.

Prism-based 3-sensor imaging vs. interpolated Bayer mosaic sensors

Bryce Bayer, the engineer at Eastman Kodak whose name is associated with his Bayer filter innovation, created a very compact and efficient way to layer a color filter atop a monochrome sensor. The vast majority of today’s color cameras – in both machine vision and consumer imaging – utilize precisely such a color filter mechanism to interpolate color. When the resolution is sufficiently fine, the rendered image is typically good enough for many applications.

But “good enough” for some isn’t the same as good enough for all

Interpolation is a form of estimation – in the case of a Bayer filter its design presumes that the Red, Green, and Blue values between each of the “true” measurements of those values is the average of the values at the accurate points. So the in-between values are computed, and may or may not correlate to the true color present at the source.

For certain machine vision, industrial imaging, and medical applications, maximum color accuracy is essential.

What’s best for my application?

Read on, for more detail. Or give us a call at 978-474-0044. Or tell us about your requirements and we’ll contact you.

Contact us

For certain applications, color accuracy and fidelity is essential

Applications note provides further information – Courtesy JAI
See corresponding applications note for details – Courtesy JAI
See applications note for more – Courtesy JAI
All four images and and associated texts above – Courtesy JAI

JAI adds 3 new 5.1 Mpix cameras to its Apex Series

5.1 Megapixel prism-based 3 sensor camera – Courtesy JAI

Previously JAI’s Apex prism-based camera series included 1.6 Mpix and 3.2 Mpix models. Three new models join the series, at 5.1 Megapixels each. The new members all use the same SONY IMX548, one of the Pregius S sensors.

If the new 5.1 Mpix models all use the same sensors, why are there three models? Because there are three interface options, depending on your need for speed.

  • 5 GigE model: 32 fps
  • CoaXpress model: 75 fps
  • Camera Link model: 55 fps

Numerous features and benefits

There are many features designed into the Apex series cameras, including binning, single and multi-region ROI, chromatic aberration correction, and automatic level control. Download a manual for details. Or call us at 978-474-0044.

Feature highlight: Per-channel exposure control

Since the rationale for a 3 sensor prism camera is color performance, the per-channel exposure control feature helps to achieve that goal. By adjusting the exposure time for each channel separately, the camera increases signal without amplifying noise.

Per-channel exposure control – Courtesy JAI

Call us at 978-474-0044 to learn more about JAI Apex cameras. Tell us about your application goals and requirements, and we’ll help you determine the best camera, lens, lighting, filters, and software. It’s what we do.

1st Vision’s sales engineers have over 100 years of combined experience to assist in your camera and components selection.  With a large portfolio of cameraslensescablesNIC cards and industrial computers, we can provide a full vision solution!

About you: We want to hear from you!  We’ve built our brand on our know-how and like to educate the marketplace on imaging technology topics…  What would you like to hear about?… Drop a line to info@1stvision.com with what topics you’d like to know more about.

IDS integrates Sony IMX900 into uEye low-cost models

Small housings and powerful sensors didn’t used to appear together. But thanks to ever more compact electronics, and good engineering, one can have both. IDS has expanded its portfolio by integrating the Sony Pregius IMX900 sensor into selected models of the compact USB3 uEye XCP, XLS and GigE uEye LE series.

uEye low cost cameras with Sony Pregius IMX900 sensor – Courtesy IDS

The photo above provides an at-a-glance overview of the various board-level, housing, and lens-mount options, each of which is classified as low cost and very compact.

If you prefer a tabular view like the following, with clickable links to specs and the option to request a quote, go to 1stVision’s cameras page, and scroll down to the selector page with drop-down filters, at https://www.1stvision.com/cameras/industrialCameras

The image below is an annotated screenshot, where the manufacturer (IDS) and the sensor (Sony IMX900) bring you to the 10 distinct camera models utilizing this sensor.

Sony’s Pregius sensor evolution

Sony is an industry leader with its Pregious sensor series, on which we’ve written previously with an overview. The Sony IMX900 is in the Pregious S 4th generation, extraordinarily sensitive thanks to Sony innovations including the back-illuminated stacked architecture.

Back-illumination improves sensor quantum efficiency – Courtesy IDS and Sony

VIS plus NIR sensitivity

We won’t bother showing VIS images in monochrome or color but of course they look great. But calling out a special capability of the Sony IMX900 – it’s also very sensitive to near infrared (NIR). Besides being part of the Pregious group, the IMX900 utilized STARVIS 2 technology, yielding NIR performance.

Yet another Sony IMX900 feature: Quad HDR

While high dynamic range (HDR) features aren’t new per se, Quad HDR on the Sony IMX900 takes HDR to another level. Getting the dark sections sufficiently saturated while not oversaturating the brighter regions is really evident with Quad HDR below.

Quad HDR generates a balanced image – Courtesy IDS

The feature list goes on and on

Call us at 978-474-4000 to learn more about this remarkable sensor and the range of IDS uEye cameras into which the sensor has been designed.

Even more features – Courtesy IDS

1st Vision’s sales engineers have over 100 years of combined experience to assist in your camera and components selection.  With a large portfolio of cameraslensescablesNIC cards and industrial computers, we can provide a full vision solution!

About you: We want to hear from you!  We’ve built our brand on our know-how and like to educate the marketplace on imaging technology topics…  What would you like to hear about?… Drop a line to info@1stvision.com with what topics you’d like to know more about.