Dear Fellow Scholars, this is Two Minute Papers with Károly Zsolnai-Fehér.
What is super resolution?
Super resolution is process where our input is a coarse, low resolution image, and the
output is the same image, but now with more details and in high resolution.
We'll also refer to this process as image upscaling.
And in this piece of work, we are interested in performing single image super resolution,
which means that no additional data is presented to the algorithm that could help the process.
Despite the incredible results seen in practically any of the crime solving television shows
out there, our intuition would perhaps say that this problem, for the first sight, sounds
impossible.
How could one mathematically fill in the details when these details are completely unknown?
Well, that's only kind of true.
Let's not confuse super resolution with image inpainting, where we essentially cut an entire
part out of an image and try to replace it leaning on our knowledge of the surroundings
of the missing part.
That's a different problem.
Here, the entirety of the image is known, and the details require some enhancing.
This particular method is not based on neural networks, but is still a learning-based technique.
The cool thing here, is that we can use a training dataset, that is, for all intents
and purposes, arbitrarily large.
We can just grab a high resolution image, convert it to a lower resolution and we immediately
have our hands on a training example for the learning algorithm.
These would be the before and after images, if you will.
And here, during learning, the image is subdivided into small image patches, and buckets are
created to aggregate the information between patches that share similar features.
These features include brightness, textures, and the orientation of the edges.
The technique looks at how the small and large resolution images relate to each other when
viewed through the lens of these features.
Two remarkably interesting things arose from this experiment:
- one, it outperforms existing neural network-based techniques,
- two, it only uses 10 thousand images, and one hour of training time, which is in the
world of deep neural networks, is so little, it's completely unheard of.
Insanity.
Really, really well done.
Some tricks are involved to keep the memory consumption low, the paper discusses how it
is done, and there are also plenty of other details within, make sure to have a look,
as always, it is linked in the video description.
It can either be run directly on the low resolution image, or alternatively we can first run a
cheap and naive decade-old upscaling algorithm, and run this technique on this upscaled output
to improve it.
Note that super resolution is a remarkably competitive field of research, there are hundreds
and hundreds of papers appearing on this every year, and almost every single one of them
seems to be miles ahead of the previous ones.
Where in reality, the truth is that most of these methods have different weaknesses and
strengths, and so far I haven't seen any technique that would be viable for universal use.
To make sure that a large number of cases is covered, the authors posted a sizeable
supplementary document with comparisons.
This gives so much more credence to the results.
I am hoping to see a more widespread adoption of this in future papers in this area.
For now, when viewing websites, I feel that we are close to the point where we could choose
to transmit only the lower resolution images through the network and perform super resolution
on them locally on our phones and computers.
This will lead to significant savings on network bandwidth.
We are living amazing times indeed.
If you are enjoying the series, make sure to subscribe to the channel, or you can also
pick up really cool perks on our Patreon page through this icon here with the letter P.
Thanks for watching and for your generous support, and I'll see you next time!
For more infomation >> Provocarea Ghicește YouTuberul ,,activati subtritrarea,, - Duration: 6:46. 
For more infomation >> CapriPay App. Часть 2. Поиск Продавцов - Duration: 2:40. 
For more infomation >> Top 8 des éléments de la panoplie du babos - Duration: 2:26. 
For more infomation >> Ako zvýšiť návštevnosť webu cez YouTube videá - Duration: 8:25. 
For more infomation >> Mi vagyunk a filmek és a sorozatok - Februárban az HBO-n - Duration: 1:19. 
For more infomation >> Wunderwerk Flüsse: Das leisten unsere blauen Lebensadern - Duration: 1:46. 
For more infomation >> WWE RAW Türkçe Altyazı | Brock Lesnar Günah Çıkartıyor! - Duration: 9:06. 
Không có nhận xét nào:
Đăng nhận xét