Starvin Larry

Matching an infrared image of a face to its visible light counterpart is a difficult task, but one that deep neural networks are now coming to grips with.

One problem with infrared surveillance videos or infrared CCTV images is that it is hard to recognize the people in them. Faces look different in the infrared and matching these images to their normal appearance is a significant unsolved challenge.

The problem is that the link between the way people look in infrared and visible light is highly nonlinear. This is particularly tricky for footage taken in the mid- and far-infrared, which tends to use passive sensors that detect emitted light rather than the reflected variety.

Today, Saquib Sarfraz and Rainer Stiefelhagen at the Karlsruhe Institute of Technology in Germany say they’ve worked out how to connect a mid- or far-infrared image of a face with its visible light counterpart for the first time. The trick they’ve perfected is to teach a neural network to do all the work.

The way a face emits infrared light is entirely different from the way it reflects it. These emissions vary according to the temperature of the air and the temperature of the skin, which in turn depends on the person’s activity levels, whether he or she has a fever and so on.

There’s another problem that makes comparisons difficult. Visible light images tend to have a high resolution while far infrared pictures tend to have a much lower resolution because of the nature of the cameras that take them. Together, these factors make it hard to match an infrared face with its visible light counterpart.

But the recent improvements in deep neural networks in tackling all kinds of complex problems gave Sarfraz and Stiefelhagen an idea. Why not train a network to recognize visible light faces by looking at infrared versions?

There are two important factors that have combined in recent years to make neural networks much more powerful. The first is a better understanding of how to build and tweak the networks to perform their task, a technique that has led to the creation of so-called deep neural nets. That’s something Sarfraz and Stiefelhagen could learn from other work.

The second is the availability of huge annotated datasets that can be used to train these networks. For example, accurate automated face recognition has only become possible because of the creation of vast banks of images in which people’s faces have been isolated and identified by human observers thanks to crowdsourcing services such as Amazon’s Mechanical Turk.

These data sets are much harder to come by for infrared/visible light comparisons. However, Sarfraz and Stiefelhagen found one they thought could do the trick. This was created at the University of Notre Dame and consists of 4,585 images of 82 people taken either in visible light at a resolution of 1600 x 1200 pixels or in the far infrared at 312 x 239 pixels.

The data set contains images of people smiling, laughing and with a neutral expression taken in different sessions to capture the way people’s appearance changes from day to day, and in two different lighting conditions.

They then divided each image into a set of overlapping patches, 20 x 20 pixels in size, to dramatically increase the size of the database.

Finally, Sarfraz and Stiefelhagen used the images of the first 41 people to train their neural net and the images of the other 41 people to test it.

The results make for interesting reading. “The presented approach improves the state-of-the-art by more than 10 percent,” say Sarfraz and Stiefelhagen.

What’s more, the net can match a thermal image to its visible counterpart in just 35 milliseconds. “This is therefore, very fast and capable of running in real-time at ∼ 28 fps,” they say.

It is by no means perfect, however. At best, its accuracy is just over 80 percent when it has a wide range of visible light images to compare the thermal image against. The one-to-one comparison accuracy is just 55 percent, however.

Better accuracy is clearly possible with bigger datasets and a more powerful network. Of these, the creation of a data set that is bigger by orders of magnitude will be by far the harder of the two tasks.

But it’s not difficult to imagine such a database being created relatively quickly, given that interested customers are likely to be the military, law enforcement agencies and governments who generally have deeper pockets when it comes to security-related technology.

source

Ref: arxiv.org/abs/1507.02879 : Deep Perceptual Mapping for Thermal to Visible Face Recognition

“She thought she was attending this conference to learn how students can be supportive of their homosexual peers, how they can bring unity to her school. She went thinking it was going to be on bullying, and she wanted to learn how to be more supportive, inclusive and accepting,” the father said.

“When she got there, it wasn’t really on bullying; it was basically a sexual education class for same-sex couples,” he said. “It was crude. One presenter told students who asked whether anal sex hurt that, as a lesbian, it really depended on how big the device is that their partner straps on.”

h/t Wirecutter

Nobel Prize-winning novelist Toni Morrison says she wants to see an officer shoot an unarmed white teenager in the back before agreeing that the “conversation about race” is over, but she almost certainly already has received her wish.

An analysis released last week shows that more white people died at the hands of law enforcement than those of any other race in the last two years, even as the Justice Department, social-justice groups and media coverage focus on black victims of police force.

Read the Whole Thing

Via NC Renegade here

It appears the speed of the “fundamental transformation of America” is increasing.
The recent “mass shootings” is increasing the demand for more “common sense” gun control-as usual the leftists/marxists are dancing in the blood of the victims before they are even buried-their mantra of “never let a good crises go to waste” is being followed to a “T”.
It’s long past time to stick a fork in FUSA-it’s done,gone-the “fundamental transformation” is almost complete.

Via The Aging Rebel here

This afternoon, the Reporters Committee for Freedom of the Press and 15 additional organizations devoted to professional journalism filed an Amici Curiae, or Friends of the Court, brief  with the Court of Appeals for the Tenth District of Texas n behalf of a motion to lift the gag order imposed June 30 by Judge Matt Johnson on Scimitars Motorcycle Club member Matt Clendennen, his lawyer Clint Broden and others in the case.

The Reporters Committee provides free legal resources, support, and advocacy to protect the First Amendment and freedom of information rights of journalists working in areas where United States law applies. The other friends of the court are The Center for Investigative Reporting, Courthouse News Service, Cox Media Group, Inc., First Look Media, Inc., Gannett Co., Inc., Hearst Corporation, Investigative Reporting Workshop at American University, National Newspaper Association, The National Press Club, National Press Photographers Association, The New York Times Company, Newspaper Association of America, Radio Television Digital News Association and The Seattle Times Company.

The Brief

The brief argues:

“ The gag order imposed in this case places unconstitutional restrictions on speech and prevents members of the media from gathering the news and reporting on matters of significant public interest. The trial court failed to apply the correct legal standard for determining whether and to what extent the constitutional rights of the press and the public under the First and Fourteenth Amendments and Article I, Section 8 of the Texas Constitution must yield to preserve (Clendennen’s) ability to receive a fair trial by an impartial jury. The record in this case does not include any findings of inflammatory or prejudicial media coverage that would support a determination that (Clendennen’s)  fair trial rights would be threatened in any way by public access to information about his case – let alone findings of prejudice to the extent required to justify curtailing the exercise of state and federal constitutional rights. For that reason alone, the trial court’s gag order must be vacated.

“Moreover, the gag order is unconstitutionally vague and overbroad. Not only does it purport to restrain the speech of too many individuals, including witnesses and law enforcement officers who do not possess information that could jeopardize (Clendennen’s) fair trial rights, but the order also restricts too much speech and is of unlimited duration. The order prevents any gagged individual from making any comment whatsoever to the media, without regard to whether the information is innocuous, purely factual, or already a matter of public record. Unlike gag orders that have passed constitutional muster, the gag order’s ‘no comment’ rule does not preserve for (Clendennen’s)  or his counsel the right to assert his innocence, the right to generally discuss legal claims and defenses, or the right to communicate with the media about the status of the proceedings against him. The trial court made no attempt to narrowly tailor the gag order to prevent dissemination only of prejudicial material, or even to limit the order’s duration. It is unclear from the language of the gag order what speech – if any – concerning (Clendennen’s) case or the underlying incident falls safely outside its ambit.

“In addition, the trial court failed to give proper consideration to alternatives designed to safeguard the integrity and impartiality of a jury, including voir dire, which is normally sufficient to root out prejudice, even in the most high-profile
and publicized of criminal trials.”