Showing posts with label research. Show all posts
Showing posts with label research. Show all posts

Saturday, February 15, 2025

Snooping on YouTube

 


If you are curious about something but nobody is willing to tell you, what do you do?

Recently, BBC reported on an interesting method of gathering market intelligence. The question researchers at the University of Massachussetts were trying answer was - how big is YouTube?

This may sound like a simple question but for various reasons - commercial, or otherwise - this is not the kind of information YouTube, or its parent company, Google, would like to place in the public domain. As the article puts it - 

In its 20 years of operation, YouTube has shaped entire generations' sensibilities and redefined global culture. Surveys show YouTube is the most popular social media site in the US by far, with 83% of adults and 93% of teenagers among its patrons. It's the second-most-visited website on Earth by most estimates, topped only by Google.com itself. But as the platform enters its third decade, the most basic facts about YouTube are still a closely guarded secret.

So how did the researchers at UoM get this information?

They started with the URLs that appear for almost all YT videos. They all start with  "youtube.com/watch?v=", and a unique 11-character identifier. Eg - Gangnam Style's identifier is 9bZkp7q19f0

This is where the raw computing power comes in. 11 random alpha-numeric characters can be arranged in more than 18.6 quintillion ways! So the researchers then wrote a program that would trawl the internet with random addresses and download the videos that scored a hit. It seems to collect the first 10,016 videos, the scraper tried more than 18 trillion potential URLs!

The conclusion?

When Google first acquired the platform in 2006, around 65,000 videos were uploaded every day. By 2022, they calculated that YouTube housed more than nine billion videos. By mid 2024, that number had grown to 14.8 billion videos, a 60% jump!!

In the cat and mouse game of corporates and snoops, perhaps it is just a matter of time before YT/Google comes up with ways to foil this kind data-collection and verification. 

--------------------------------------------

REFERENCES & LINKS

https://www.bbc.com/future/article/20250213-youtube-at-20-a-computer-that-drunk-dials-online-videos-reveals-statistics-that-google-doesnt-want-you-to-know

Sunday, October 31, 2021

Life and Beyond

 Call it a calculated conspiracy of algorithms but over the last week I watched two 'recommended' TED videos, each dealing with with dimensions of life and death.

The first one was by Isabel Stenzel Byrnes titled the "The Art of Saying Goodbye", and the second one by Nancy Trivellato on Out-of-Body Experiences (OBE).

Isabel describes her own harrowing experiences with Cystic Fibrosis, numerous encounters with the death, end-of-life issues, and organ donation. She also talks about her realisation that there is no right or wrong way to say goodbye to a loved one, and that grief is an art, a deeply intellectual and spiritual process of making sense of loss.


I was particularly touched by this description of grief by Isabel's friend, Christine:

"If you were to ask me what stage of grief I'm in, I would say denial, anger, fear, profound sadness...sequentially, and then all at once, and sometimes not at all."

The second TED video by Nancy Trivellato, a researcher from Brazil, begins with a question that has long been familiar to ancient Indian philosophers - "Is the reality we live in the actual reality?". The point being made here was that the 'reality' being presented to us by our sense organs give us, at best, only a small fraction of the many realities that exist in parallel. Nancy makes this point by presenting a set of photographs of the cosmos, each showing how instruments that detect different parts of the electromagnetic spectrum see the same slice of the night sky so differently.

However Nancy's talk is not about the EM spectrum or the cosmos but something more subtle. She describes how as a child she had an out-of-body experience of 'seeing' a beloved uncle on a hospital bed in Sao Paolo. He and his wife had gone there for a gall bladder operation without informing anybody and were quite astounded to hear the little girl describe his hospital room.

The common thread that runs through both these videos is that there is more to life and death, and dimensions of consciousness that needs our attention with tools that are beyond the reach of existing scientific instruments and conceptual frameworks. 

------------------------------------

* TED Video - "The Art of Saying Goodbye" (Isabel Byrnes) - https://youtu.be/Dkffpibi-Dc

* TED - Nancy Trivellato on OBE - https://youtu.be/NMBNZspmn7I

* The Power of Two - A Twin Triumph Over Cystic Fibrosis - https://www.amazon.com/Power-Two-Triumph-Cystic-Fibrosis/dp/0826217540 

Tuesday, April 08, 2014

Guha on Import Dependence

"Almost all elected members of GRC are SSB prize winners...an entry into this club means that you have arrived"

In the world of Indian sci-tech GRC and SSB are acronyms even a novice would know. The former stands for Guha Research Conference set up in the name of B. C. Guha, and the latter, the Shanti Swarup Bhatnagar Prize.

This makes it all the more strange that a Google search on GRC would only get you a long list of Indian scientists who are proud to call themselves "elected members" without any publicly accessible information on how this club functions. There was no Wikipedia page on Guha Research Conference, until today.

According to Parthasarathi Banerjee, affiliation to GRC, "acts as the token, assuring easier access to prizes of several sorts."  The SSB Prize is one of them.

As far as institutions go, GRC presents an interesting case to all those who are curious to know why India's output is so sad when it comes to applied S&T. The organization is named after Prof. Bires Chandra Guha (1904-1962) who is referred to as the 'father of modern Indian biochemistry'.

Guha was, no doubt, a person of many interesting dimensions. He was a freedom fighter, an artist and a scientist who worked closely with many Nobel laureates in UK and USA. After independence, he returned to India and helps establish many a national institution like CFTRI, Mysore.

Way back in 1956, he made a sharp observation - "It is undesirable that practically all fine instruments of measurements should have to be imported. Biochemical researches in these days are greatly dependent on such instruments and biochemists in this country should make a special plea for the manufacture of these instruments".

Half-a-century later our labs continue to be helplessly dependent on foreign manufacturers for nearly all their equipment and reagents.

It would be interesting to know that the eminent members of GRC have been doing to solve this long-standing problem..


---------------------------------------------------------
LINKS

* Wiki on GRC  (created 7 April 2014) -- http://en.wikipedia.org/wiki/Guha_Research_Conference

* Biresh Chandra Guha: Father of Modern Biochemistry in India -- http://www.iisc.ernet.in/currsci/sep252004/823.pdf

http://books.google.co.in/books?id=dLT2PMgI7MsC&pg=PA231&lpg=PA231&dq=guha+GRC+india&source=bl&ots=m4w1gtdCe3&sig=u_wgXWGeeEzfG30l4tW4aOfLFNU&hl=en&sa=X&ei=s1JCU5ulGsWFrAeC3oDIDw&ved=0CEoQ6AEwBA#v=onepage&q=guha%20GRC%20india&f=false

Friday, September 27, 2013

Down the Digital Memory Lane

Copy of a Book Review published in the Hindu Business Line on 27 September 2013
...........................................................................................


Digital memory of a billion-plus nation
R. Dinakar


Digital Republic: India’s rise to IT power — History and Memoir By Mathai Joseph Publisher: Power Price: Rs 299

September 26, 2013:  

"Computing”, says Mathai Joseph, “has become a metaphor for what can be achieved in India. It has given recognition to India as no other science or technology has.”
He would know, as he was one of the country’s first computer scientists, was a part of the nascent Computer Group at Tata Institute of Fundamental Research (TIFR), and a former head of research at TCS. Having spent over 45 years understanding the capability and behaviour of computers — from an era where ‘memory’ meant rolls of perforated paper, to the advent of cloud computing — he stands at a unique vantage point to narrate the story of India’s tryst with information technology.
Joseph’s book Digital Republic — India’s rise to IT power, is a memoir for our times. Starting with the early 1960s, Bombay provides a colourful backdrop to his college-years, the beginnings of an enduring love for literature, theatre and music, and to his long stint with TIFR. It is here that the freshly minted PhD from Cambridge struggled to convince the scientific establishment that computing deserved strategic support, alongside nuclear energy and space science.
The bosses at TIFR, however, refused to set aside their blinkers. While major strides were being made elsewhere, 1960-1975 marked the lost decade for Indian computing. Stuck in the fog of the Cold War, it lost not only the momentum gained from the first indigenous computer — TIFRAC (1960) — but also a great opportunity to create a manufacturing base for computer hardware in India.
Much like the story of IT in India, the book too has its ups and downs. The initial chapters might seem rather pedestrian, with their cryptic titles (Self at BBVT, Byculla Byeways) and rambling descriptions that almost make you wonder if you picked a Chetan Bhagat by mistake. However, if you persist beyond Chapter 3, Digital Republic gets back on track, and offers a fascinating narrative of computing through its formative years.
Initially, Joseph had been confounded by digital computers — “How could programs and data lie together in the computer memory?” he wondered, “just like a librarian stacked on a shelf with books!” Hands-on exposure helped. For the first time, at Cardiff, he had access to the latest machines of the time — ESDAC-1 and the Stance Zebra computer, and to the latest programming language — Algol 60. Expertise built on these systems helped him gain admission to Churchill College at Cambridge for a PhD. Later, a recommendation from Cambridge, and a fervent wish to avoid becoming an “immigrant”, brought him to TIFR in 1968.
The author returns time and again to the frustrations of working at TIFR. Initial admiration for the team leaders’ managerial acumen seems to have given way to a growing sense of disappointment. Instead of working on operating systems, Joseph was asked to work on computer graphics, where he found himself treading on a colleague’s zealously guarded turf.
So he moved on to experimental computing, seeking faster methods to translate programming language into machine language; better methods of allocating storage, and trying new synchronisation techniques in designing operating systems. Here again he found his team’s efforts being compared poorly against the experimental physicists who seemed to be on their own “serendipitous jaunt”, busy fitting “a few more pieces into an already well-understood mosaic”. Joseph sadly notes that “Science at TIFR was run as a collection of fiefdoms with the suzerainty of each leader unquestioned and unchanged till his eventual retirement”.
Finally, in the 1970s, when the Government set up a separate Department of Electronics, the career bureaucrats ensured it would remain under their thumb — unlike nuclear energy and space science. In the name of “self-reliance” they continued to make technologically unsound decisions, until companies such as TCS redeemed IT for India, with their world-class products and services.
This self-published book holds valuable lessons, not only for those with interest in science and technology but also for policymakers and bureaucrats. It is certainly a reminder of opportunities lost, and of what could yet be achieved in India, if only we can shake some of our institutions out of their smug, self-serving complacency.
A more fitting title for the book might have been, “India’s Rise to IT Power — despite the Government”.

The reviewer is an independent consultant specialising in ‘Technology for Development’.
(This article was published on September 26, 2013)

Printable version | Oct 2, 2013 10:40:57 PM | http://www.thehindubusinessline.com/features/weekend-life/digital-memory-of-a-billionplus-nation/article5167990.ece © The Hindu Business Line



Wednesday, February 06, 2013

A Tale of Two Aircraft Manufacturers'


HAL and Embraer are two companies set up by governments in India and Brazil respectively, more than four decades ago.  Both sought to break an oligopoly dominated by a handful of aircraft manufacturers in the developed world.

While Embraer has been a spectacular global success, HAL continues to be a staid, stagnant company. Embraer has produced more than 5,000 aircraft that operate in 92 countries on five continents, and it is the market leader for commercial jets with up to 120 seats. HAL, on the other hand, has manufactured (mostly under license), over 3658 Aircraft/Helicopters, 4178 Engines, Upgraded 272 Aircraft and overhauled over 9643 Aircraft and 29775 Engines.

Both companies had very similar origins. Embraer was started out as a government controlled company in 1969 - nearly thirty years after HAL was established in Mysore. And yet, within a span of a few decades, Embraer has become a world leader in the manufacture for executive jets while HAL has nothing significant to show for itself - except, of course, 'upgrading & overhauling' equipment for the domestic market and licensed-production of aircraft from other countries.

What explains this difference?

In a book titled, "The World Aircraft Industries", the authors note that most of HALs efforts, in conformity with other Newly Industrialised Countries (NICs), aimed at license-production of aircraft'. Brazil took a slightly different tack - it first established a a specialised institute for aeronautical engineering research and education in the 1940s. Then, more than two decades later, in 1969, after the basic technical infrastructure was well in place, the government set up Embraer to design and manufacture aeroplanes. Also, from the very beginning, Embraer traversed two paths in parallel — one, manufacturing planes to its own design and, two, manufacturing aircraft under licence.

According to Prof. RT Krishnan of IIMB, "Key elements of Embraer's success have been a clear focus on its core competence, ability to understand user needs in its niche market, quick absorption of technological capabilities, a platform or family approach to product development, cost competitiveness, and, above all, a global risk management model in what is clearly a global business."

In sharp contrast, India seems to have created R&D institutions in silos that remain only distantly connected with the manufacturing industry. Thanks to these silo's, in 2002, when the government of India wanted to buy a new set of executive jets for its VIP's, it turned to the best company in the business - Embraer.

-------------------------------------------------
LINKS & REFERENCES

Embraer, Brazil - http://www.embraer.com/en-US/Pages/Home.aspx

HAL India - http://www.hal-india.com/

Krishnan, Rishikesha K (2003): Where core competence soars, The Hindu Business Line, 1Oct2003, url - http://www.thehindubusinessline.in/2003/10/01/stories/2003100100020800.htm

IISc - Dept. of Aerospace Engineering - http://www.aero.iisc.ernet.in/

Thursday, November 24, 2011

Why Japan's R&D scores over ours

 Article published in the Hindu Businessline, 23 November 2011

................................................................................................

Why Japan's R&D scores over ours

R. DINAKAR
Indian industry has shown little interest in overtures from public sector R&D labs.
Indian industry has shown little interest in overtures from public sector R&D labs. 

 Unlike in Japan, India's ivory-tower scientists are wary of working closely with private companies and factory workers.
Institutions dedicated to public research & development (R&D) activity often exist in a world far removed from the rough-and-tumble arena of private enterprise. To some, the very idea of using taxpayers' money to enrich the business class goes against the notions of equity and social justice.
One can, however, learn from the Japanese, who have created interesting institutional mechanisms to deal with this issue. Take the case of Koguchi-san, a young, mid-level scientist and troubleshooting ‘scout', working with the National Institute of Material Sciences (NIMS), a government-funded research lab located in Tsukuba Science City, 60 km north of Tokyo. On most days, you will not see him in his comfortable NIMS office, but on a factory floor elsewhere. Dressed in overalls and boots, he rubs shoulders with workers, technicians and scientists at a private manufacturing firm — usually an SME — trying to understand their technical problems, to make their manufacturing processes more efficient and their products more competitive.
Typically, discussions continue after office hours. Koguchi-san and his counterparts hang out together, share a drink or a game of baseball during the weekends. In the process, they build a camaraderie that is very valuable for their parent organisations. Jointly-funded projects emerging from such friendships have resulted in better alloys, stronger adhesives, superconducting magnets, super-capacitors, dye-sensitised solar cells, and a host of other specialised products that Japan's SMEs supply to the bigger keiretsu conglomerates as well as global markets.

THE INDIA CONNECTION

Koguchi-san is a fictitious character. But NIMS is very real. So are the kind of working-level R&D partnerships that exist between Japanese public-funded labs and private-sector companies described above.

NIMS employs nearly 50 Indians. Most of them are post-doctoral fellows from our own premier universities and research institutes, with whom it has inked MoUs, and also offers ‘joint graduate' programmes.
Researchers from India and other countries spend a few years here working on focused research projects. The intellectual property rights (IPRs) resulting from this, of course, belongs to NIMS and the Japanese companies.
What is of interest for us here, though, is not ownership of IPRs or even the Indian connection. It is about public-private partnerships (PPP) aimed at meeting the needs of the domestic and international markets, that can be useful for Indian industry as well.

STATE AS CATALYST

The Government has a critical role in this process — not by establishing newer institutes and perpetuating a bureaucratic paralysis — but by acting as a facilitator and catalyst. Another fine example to quote here is the case of Hiroden in Hiroshima.
Hiroshima — long before it was devastated by the atomic bomb codenamed ‘Little Boy' — was home to a tramway network run by this company called Hiroden. Their network was among the first utilities to be rebuilt after the attack. The city gradually became famous as a ‘living museum of tramcars'. In 1999, the local manufacturers got a rude shock when Hiroden decided to replace its aging fleet of single-car trams with the latest imported German models.
Manufactured by Siemens, these were the sleek LF-LRT (Low Floor-Light Rail Transit) Combinos. Their modular, barrier-free, interconnected and low-floor design not only had a much bigger capacity, but also made passenger movement easier and faster.
Japanese tram makers had refrained from improving their designs for several reasons till then: Overseas manufacturers held patents for many of the basic technologies and the low domestic demand increased development risks.
This changed in 2000, when a new Barrier-Free Transportation Law was brought in by the federal Government. It provided tax relief and exemptions to compensate for the price difference between conventional cars and the more expensive barrier-free designs.
In 2001, two years after Siemens had won the Hiroden contract, Japan's Ministry of Land Infrastructure and Transport got together a group of eight manufacturers to come out with a 100 per cent Japanese product. It eventually led to three of them — Mitsubishi Heavy Industries, Kinki Sharyo and Toyo Electric Co. — forming a consortium, JTRAM, for creating an improved tram better suited to Japanese conditions. MHI produced the bogies, brakes and inner/outer riggings; Kinki Sharyo focused on the design, car body, articulations, and driver's cabin; and Toyo took responsibility for the electrical parts and control drive units.
The result was ‘Green Mover Max', a vehicle that had more seats, wider aisles and lower dependence on foreign technology and component-makers than the Siemens Combinos, which, meanwhile, started developing problems.
In 2004, the German company admitted that their body-shells were developing cracks after high mileages (15,000 km-plus). By now, JTRAM was ready and waiting. In 2005, Hiroden accepted the first LF-LRT built entirely in Japan. And today, JTRAM not only dominates the local market, but also gives Siemens a run for its money in the international markets.

TWO-WAY STREET

In India, the Japanese PPP model — which we have seen at work even in the more recent period — would be looked upon with a mixture of suspicion and disdain. Our scientist-administrators are wary of working closely with private companies or discussing technical problems with mere factory workers. What is the point in soiling one's hands, when promotions are linked to more ‘intellectual' activities like filing patents or publishing papers — preferably in Western journals!
There are, of course, exceptions that are often the result of one-off individual initiatives. The rice miller, Anil Mittal's chance visit to the Indian Agricultural Research Institute in Delhi turned a promising basmati strain called Pusa-1121 into a commercially-cultivated variety that now earns India more than $1 billion in annual export earnings.
But in many cases, it is industry that has shown little interest in overtures from public sector R&D labs. When the Central Mechanical Engineering Research Institute at Durgapur found no takers for its indigenous tractor design in the late 1960s, its own scientists led by Chandra Mohan took the lead to commercialise ‘Swaraj' tractors through Punjab Tractors Ltd.
On the other hand, a CSIR laboratory tried to collaborate with the cashew industry in Kerala, to jointly develop a better technology for mechanical roasting and peeling of raw nuts. But high-level discussions yielded nothing, as the industry was happy working with cheap labour. Today, high labour costs have forced mechanisation and cashew makers import the necessary equipment — from Vietnam!
A top-down approach has been a characteristic of our public-private interactions in R&D. It is high time we created incentives for our middle-level managers to seize the initiative. If, as with Koguchi-san at NIMS or the people at JTRAM, our R&D institutions make concerted efforts to build relationships and to understand the industry's needs, India too, can emerge as a hotbed of innovations.
It's time we stepped out of our institutional silos and stirred an inter-disciplinary cauldron of ideas. Our academics need to step down from their ivory towers, roll-up their sleeves, and empower their younger colleagues to bridge the yawning gap between ‘research' and ‘development' in India. 

(The author is an independent technology transfer consultant.) 

(This article was published on November 23, 2011)