Saturday, May 21, 2011

House of Saud

Review of two books on Saudi Arabia, springboard of Wahhabism, Al Qaeda, and peak oil.

[Note to readers- the blogspot overlord (pbuh) offers several new presentation formats, which you may be interested in, though "sidebar" seems the only remotely appropriate one.]

The Dune trilogy is one of the great science fiction works, with exotic setting, stirring drama, and fascinating ideas. But I hadn't been aware how much, consciously or unconsciously, it drew from reality, in the form of Islamic, and especially Arabian, history. Action centers on a desert planet, which produces a special substance to which the rest of the human-inhabited galaxy is addicted. Planet Arrakis is inhabited by wild tribal nomads, who eventually adopt a savior, and through a religiously zealous jihad (riding on sandworms, indeed) overturn the reigning aristocratic system and become rulers of the known universe, only to (fore)see the jihad run amok once the religious genie is out of the bottle.

With apologies to the Dune franchise ...

Unfortunately, it has been a long time since I read it, so I will beg off making more detailed parallels. But the unifying theme, as usual, is power and its nexus with religion. There is no more socially motivating force than religion. Yet there is also no more idiosyncratic, emotion-laden, and irrational force. What will people die for? Rarely for anything that makes sense, rather typically for an archetypal construct that expresses their deepest feelings and stirs essential meanings, especially if it offers the bonus of eternal life in heaven. Such things as ethnic, religious, and national identity typically fit the bill.

So what could be more appropriate, in this season of royal pageantry, killing of enemy #1, Jasmine revolutions, and our dawning recognition of peak oil, than to delve into the history of the world's last remaining real monarchy & country named after a family, and origin and home of the most uncompromising form of that most volatile religion-  Saudi Arabia?
"I am not Queen Elizabeth!"- King Saud ibn Abdul Aziz al Saud, upon being asked to be a figurehead. He was then deposed by his brothers, in 1964. (Lacey)

My local library stocks two excellent books on Saudi Arabia- The Kingdom, by Robert Lacey (1981), who apparently is royalty-besotted, having just come off a biography of QE2, and The Siege of Mecca, by Yaroslav Trofimov (2007). The latter is particularly good and focuses on the little-remembered yet highly influential takeover of the Kaaba in Mecca by a well-led and well-equipped band of proto-Al Qaeda millenarians in 1979. The former offers a more conventional, sweeping, and mostly sympathetic history of the Sa'ud since the late 1800's. Both tell the essentials of how the Saudi family nurtures and relies on religious fundamentalism for their internal power as well as external influence.

Power in traditional societies tends to be personal rather than institutional. Empires raised by charismatic personalities crumble just as quickly after their deaths. The terrorist landscape of Al Qaeda and the Taliban is an endless scroll of "commanders" with small groups having friendly, but not fully integrated, relations. This is one reason why the death of OBL is more promising than Westerners typically assume.

Arabia is exemplary in this respect, with tribes traditionally competing for power, and men competing for leadership within their families / tribes. Respect for elders is intense in this conservative society, but not to the point of primogeniture. Leaders have to earn their followings. This led, for instance, to substantial difficulties after the prophet Muhammad died, since many tribes that had converted to Islam regarded this as purely personal allegiance to him rather than an irreversible fall down some abstract theological rabbit hole. The ensuing wars led to a major crisis, whose resolution (i.e. reconquering the Arabian peninsula) led the Islamic warriors far afield and towards world domination.

Likewise with the founder of the modern Saudi state, Abdul Aziz ibn Abdul Rahman al Saud. Through a bold stroke of guerrilla warfare, he took over the capital of central Arabia, Riyadh, from the competing tribe of the Rasheeds at the young age of 26 in 1902. His father (Abdul Rahman) was still alive and head of the family, but let Abdul Aziz have all the glory and power he had earned, after which Abdul Aziz systematically turned surrounding tribes with his generosity, personality, and when necessary, force of arms.
"There were two types of desert warfare, Abdul Aziz's grandfather Faisal had told Colonel Pelley in 1865: religious war and political war. Political warfare involved compromise. But 'when the question is one of religion,' the old man had explained, 'we kill everybody.'" - Lacey

His key to gaining the vast area of today's Saudi Arabia was another inheritance from Muhammad, in the form of Islamic fundamentalist warriors. The Sa'ud family had since 1744 been allied with the ultra-conservative Wahhabi movement, whose main aim was to convert Arabs (especially the nomadic bedouin) from various lax semi-islamic and semi-animistic practices to pure & stringent Islam. The Wahhabis had plundered and massacred as far afield as Mecca and Karbala, Iraq in 1802. This alliance was revived and extended by Abdul Aziz after learning that a new fever of puritanism had swept some bedouin in the wastes to the north of Riyadh into a pious settled existence, calling themselves the brotherhood (Ikhwan).

The Ikhwan were not good farmers, and however devout, the oasis life wasn't economically successful. Abdul Aziz offered them a sympathetic ear, and pointed them towards Jihad, conveniently directed at various of his enemies in turn (between 1912, and the final battle in 1929 when the Saudis turned and emasculated the Ikhwan). The climax came in 1924 when the Ikhwan captured and massacred the inhabitants of Taif, the gateway to Mecca from the interior. The relatively cosmopolitan coastal residents quickly agreed to accept Abdul Aziz as their new overlord if he would (as he did) spare them a similar fate.

The original Wahhabis had massacred Taif previously in 1802, taken over Mecca, and instituted a Taliban-like rule that was far from forgotten. So the Saudis have been proud, but also quite nervous, stewards of the holy precincts of Mecca and Medina. They were looked down upon by the rest of the Islamic world as country bumkins and fundies. The Wahhabis had a tendency to kill other Muslims whom they labeled as apostates. Were Shiah going to be welcome in Mecca? The Saudis didn't want to end up like the Taliban in Afghanistan, reviled by most of the Islamic world for their fanatical puritanism. Abdul Aziz kept the Wahhabi clerics, not to mention the Ikhwan, on a short leash.

Meanwhile, in 1913, Abdul Aziz exploited Turkish weakness and distraction during World War 1 to take Hofuf, the capital of Eastern Arabia (the Al Hasa). Using the same minimalist guerrilla tactics of his Riyadh coup, the site of Saudi Arabia's current oil riches (and a heavily Shiah-populated area) was his virtually without a fight.
"It was Westerners who discovered and developed the Kingdom's fabulous treasure chest. Western economic theories and techniques are the basis of the Kingdom's present development plans. Without the ongoing development of the Western economies there would little market fro the commodity on which the Kingdom's good life is based - and almost every detail of that good life depends on imported foreign labour [and technology and goods] for its smooth running: in a Sa'udi hotel the receptionist is Moroccan, the waiters Filipinos, the room attendants Pakistanis, the cleaners Thais, the management Lebanese, European or American- and the Saudi guests feel superior to all of tehm. Does a duke feel inferior to his tailor because he can not make a pair of trousers? Sa'udis know that God gave them all the wealth and power that they currently enjoy, and they feel neither lucky, nor surprised, nor grateful to anyone except themselves - and God." -Lacey

The Ikhwan went so far as to infiltrate and invade Kuwait in the 1920's. But with the help of the British, Abdul Aziz started boxing them in, and with no more scope for plunder and no farming skills, they became more of a problem than a solution, rebelled, and were put down definitively in 1929.

The outsize personality, wealth, and success of Abdul Aziz bought his family some time after his death in 1953, and his oldest son Saud was installed on the throne. (Of some 43 sons ... and we worry about cloning! How many royal weddings could they stage for world consumption?) But it was only with the accession of Faisal, after extensive family unhappiness and discussion, that the Saudi royal system was more or less institutionalized as a state system.

For instance, Abdul Aziz was what we might call a tea partier. He couldn't conceive of useful government services or a role in general economic development, but just gave money away as it came in, as political patronage and alms. Only under his sons (still in office, in the form of Abdullah) did Saudi Arabia engage in serious public goods development.
"Saudi Arabia has a constitution inspired by God and not drawn up by man ... True socialism is the Arab socialism laid down by the Koran." - Prince Abdullah, in Lacey

As both books describe it, the modern (more or less) Saudi royals are sincerely undemocratic, religious and sympathetic to their Wahhabi ulema (the ruling body of clerics). Yet there is constant tension between these ultra conservative clerics and the needs of governing a somewhat diverse population (including the downtodden Shia- see recent protests in Bahrain) along with economic imperatives such as hosting foreigners and introducing such modern contrivances as TV and radio.

The Saudi regime is clearly the most stringently puritan Islamic state on earth (other than the ill-fated Afghan Taliban), not to mention incredibly rich, so the ulema know that they have it relatively good and support the royals without too much grumbling. For example, back in the 50's and 60's, the Saudis welcomed radical Muslim Brotherhood members, including the brother of Sayyid Qutb, after they were suppressed in Egypt by Gamal Nasser, who disparaged Saudi Arabia as a medieval backwater. Muhammad Qutb was even made a professor in Jeddah. But ...



Here we get to the fascinating book about the Siege of Mecca, which took place in 1979. As the royal family was sitting pretty, having used the oil "weapon" to both enhance their prestige across the Islamic world and multiply their income, they were blindsided by, of all things, Islamic fundamentalism. The first expression was the rapid evaporation of the Persian royal family at the hands of the Ayatollah Khomeini. Trofimov portrays the Saudis as horrified by US weakness in the face of this coup and the ensuing hostage crisis. (Lacey sniffs, disparagingly, that the Persian royal family numbered only a few dozen, while the Saudi royal family numbered easily over 4000. Point Saudis!)

Then while the Iran crisis was at a full boil, a band of several hundred Ikhwan-like fundamentalists led by the charismatic Juhayman al Uteybi [name note- "ibn" and "al" both mean "son of.."] took over the grand mosque of Mecca and proclaimed the savior of Islam (the Mahdi) to have arrived: Juhayman's friend Abdullah al Qahtani. These revolutionaries came prepared with food, with national guard training, and plenty of weapons & ammo. They set up lethally effective sniper nests in the manarets, and held the entire Saudi army at bay for over a week. They also broadcast their messages through released pilgrims and pamphlets, convincing many outside (through a viral marketing campaign, no less!) that just perhaps, at this new century of the Islamic calendar, (year 1400), the Mahdi had indeed arrived.

Meanwhile, the Saudi government was lying through its teeth- first cutting phone and media lines to prevent any news from getting out, and then, when the US shockingly leaked the story, falsely claiming at three separate stages that the mosque had been reclaimed. Rumors swirled. Iran and the US were both blamed. US embassies all over the Muslim world were attacked (most severely in Pakistan, of course). And back in Riyadh, the royal rulers were haggling with the ulema for a fatwa allowing them to barge into the holy of holies with guns blazing.

And here is the interesting part. The ulema was fundamentally in agreement with Juhayman's radicals. Its head was, in fact, one of Juhayman's professors at the university in Medina. Horrified, yes, that they had desecrated the Kaaba, but sympathetic to the vast majority of Juhayman's manifesto that he had read out to the startled pilgrims on their hajj. This manifesto ranged from lack of democracy to a lack of jihad by the ruling Saudis. From the pollution of television to the debauchery of Saudi princes. The worship of mamon and the introduction of women to the workplace ... all the fundamentalist grievances came pouring out.

Horse-trading commenced, and the desperate Saudi princes paid a steep price for theological cooperation in purifying Islam's own shrines: a rollback of social modernization, more Wahhabi influence in the schools, and more money for the ulema to evangelize in and out of the country for its puritanical views ... the very views that had occasioned the crisis in the first place. Incidentally, in a parodic bow to modernity, the Saudi governmental department in charge of religion was at this time called the "Department of Scientific Research and Guidance". So Saudi society sank deeper into the cycle of brainwashing, ignorance, bigotry, jihadism, and extremism, which, through the providence of endless oil money, it keeps exporting assiduously to all corners of the earth. We are now familiar with the double game played by Pakistan versus its neighbors and the West. But that of Saudi Arabia has been more profound, more global, and more damaging.

Trofimov suggests that Al Qaeda was inspired by Juhayman's actions and tracts. Ayman al Zawahiri was certainly a fan. OBL was an impressionable 22 at the time of the takover, and eventually took up many of Juhayman's issues, especially the presence of infidels in Arabia. Infidels (i.e. the rest of us) were already absolutely barred from Mecca, but the fundamentalists were scandalized by any presence in the country. Especially by a military presence, which was such a sign of Arabian impotence, and which subsequently grew as the Saudis took on deeper alliance with the US to keep the Persian gulf (and their own necks) free of Iranian and Soviet influence.

Trofimov points out that the fatwa authorizing government military force to clear out the Grand Mosque justified killing Muslims in the mosque (i.e. the rebels) by declaring that, by their actions, the Juhayman group had merited rebranding as infidels. This was quite a theological summersault, since the rebels, whatever else they were and had done wrong, were pious and fundamentalist in the extreme. (We love too much, and all that!) This casual reclassification of Muslim opponents as infidels was to be redeployed by many extremists & terrorists against the very institutions the ulema was protecting- the Saudi royal family and other corrupt or modernizing rulers across the Muslim world.

It brings to mind the mutual excommunication of numerous popes and other theologians in the more dramatic phases of Christian history. This kind of essential dispute can only be resolved in three ways. The community may squelch independent thought at some level and put itself under a unitary and unquestioned authority (the Catholic solution). Or the competing communities, while retaining their individual theologies, adopt a civil, even secular, space for discourse and renounce violence / power as the arbiter of truth (the Protestant solution). Or it is possible that a community reconsiders those questions to which it had given so much thought and energy and realizes that their framework is largely imaginary, turns away from them, and concentrates on those questions that yield, or can in principle yield, to good-faith investigation (the science/atheism solution).

While one wants to pay respect to the high points of the history of Islam and its peoples, they have clearly lost ground (or returned to their martial roots) when it comes to these various mechanisms to "tame" the essential and irreconcilable conflicts of religion. A convenient solution has been to let these differences flower, but deflect their violent energies towards hapless outsiders by the convenient and practical doctrine of jihad. Darwin would have been proud!

So the Saudis sowed the seeds of the whirlwind we are reaping today, allying themselves ever deeper with their Wahhabi clerics and at the same time with those cleric's worst enemies, the US. Luckily, they were at first able to export the combustible mixture to the killing fields of Afghanistan, where a more immediate threat to the umma than TV and women's rights materialized in the form of the Soviet Union. But of course they then also inspired the horrors of the Taliban government, and exported most of the hijackers of 9/11.

The long game for Muslim hearts and minds has come back to focus on the US for the last decade. With the Jasmine revolutions, we may have turned a corner among the relatively cosmopolitan portions of the Muslim world, which reject fundamentalism in favor of liberalism and democracy. Yet the subtext remains power and legitimacy, and religion remains central. As long as the primary allegiance of Muslims is to their totalitarian religion, then legitimacy and power will flow from religion as well, empowering those who claim to speak its most fundamental truths.

From Muhammad himself through to the Wahhabis, the Ikhwan, the Juhayman-ists and Al Qaeda of today, God favors and gives power to those on his side. Success in war directly implies spiritual righteousness. It is hard to overestimate the damage that this instinctive philosophy, expressed most succinclty through the doctrine of jihad, unleashes upon the world. Most religions, including Islam and Christianity, have tried to temper this atavistic instinct with rules of engagement that restrict what brutality one can inflict in its name, but each seeks and adulates power (King of kings, the Family, the Pope, the Crusades, God bless the USA, etc..).

Muslim extremists have labored (with our help) to portray the various US invasions as crusades, which then constitute a direct clash of religions and gods, victory going to the most righteous, and the most righteous justified by their victory, whatever the abhorrent tactics employed. Yet the other side of the coin rarely shines as cogently. Has the last century of weakness and degradation led Muslims to question their religion? Has the strength and victory of Israel reconciled, even converted, its opponents to its theology? Has Islam's inability to grapple with modernity and the consequent new forms of power led to doubt and atheism? For a few, yes. But for most, no. Religious narcissism doesn't let itself become so depressed, since its fundamental purpose is to provide hope and meaning in a confusing world. Self-pitying, other-blaming narratives and conspiracy theories typically fill the gap.

"'It's all part of a great plot, a grand conspiricy, ' King Faisal replied with confidence. 'Communism, as I told you, is a Zionist creation designed to fulfil the aims of Zionism. They are only pretending to work against each other.'" - Lacey
"Fahd: 'Our enemy is ... the world Zionism, which is seeking to harm the Saudi Arabian Kingdom and to distort its role in every way possible. ... A media war was in the full sense of the word waged against us ... Psychological rape- this is the right expression.' The Saudi royals  would use precisely the same language to complain about Western reporting on Saudi affairs after September 11, 2001." -Trofimov

After they crushed the Siege of Mecca, the Saudis frantically searched for the body of the purported Mahdi, which had not turned up and was feared to have supernaturally disappeared. Finally, a mutilated half-corpse was identified, allowing the royal family to exult that the whole affair had been fundamentally illegitimate. Since as the Mahdi's own mother bluntly said:
"If my son is the Mahdi, he will kill you, if he is not, you will kill him."



What of the future? There are several interacting trends: China is the major rising power that is looking for friends in resource-rich areas of the world, while the US is, in relative terms at least, declining in dominance. Peak oil is here, so all economies will be increasingly constrained by energy scarcity. And jihadism and liberalism will continue to battle for the soul of the Muslim world.

The Saudis, despite their huge reserves of oil, seem to be having difficulty raising production. Their domestic consumption is ever-increasing, making for what looks like a plateau or peak in marketable world oil production.



It goes without saying that they will continue to export oil for decades to come, and will continue to reap the riches of ever-increasing prices.

But what of their political and social system? The gerontocracy of Abdul Aziz's sons is coming to an end, and they will have to transfer power to a new generation of princes. Saudi Arabia was not untouched by the Arab spring, coming instinctively to Mubarak's defense, feeling immediately pressed to spread an extra $36 billion, and send their army to assist their fellow Sunni rulers of Bahrain to brutally suppress protests by their Shiah majority.

On the long term, one can see that Saudi Arabia and China have a convergence of interests. Both run autocratic yet relatively stable regimes that chafe under US domination. China has the money, and Saudi Arabia has the oil. The only missing ingredients are the military power and extensive relationships the US has in the Muslim world. (Though China has cultivated the friendship of Pakistan, which offers little but hatred of India and the US.)

But now, with the Arab spring, we are at a turning point, as the US backs democracy over autocracy (though Obama in his recent speech didn't breathe a word about Saudi Arabia- the royal elephant in the room). The US wants to encourage and be friends with the future democracies of Egypt, Tunisia, Turkey, Libya, Iraq, Afghanistan, and whoever else wants to join the party. Will Pakistan be on that list? Will Syria? Will Iran? Will Saudi Arabia? It is like the dissolution of the Soviet empire, played out in very slow motion, after its quasi-religious ideology, like that of Islamism, expired from direct and painful empirical disproof.

The question is whether and how long autocracies like China, Saudi Arabia, and Cuba can hold out against the Western model of legitimate and liberal bottom-up politics. As long as they can, we will have high drama and ideological tension in world affairs, indeed great danger if China turns jingistically nationalistic and sues for hegemony over its region and over other resource-rich areas of the world.

The US has played a long and generally consistent game, encouraging country after country from autocracy to democracy, by our example and actions. The list is long, from Japan and Germany to South Korea to the Philippines and Russia. Exceptions are glaring, such as Iran, Chile, and others. Numerous countries hang in the balance. But the liberal democratic model is attractive and durable, indeed essentially irreversible once established. China is truly the outlier, as a uniquely successful authoritarian system- will it undergo a spiritual turn towards Buddhism? Will it turn fascist? Or will its government oh-so gradually transform into a lawful, democratic system, now that the primary task of economic development is well under way and its middle class is growing?

Saudi Arabia has a more conservative culture than China's, even more deferential to authority, tradition, and ideological orthodoxy. I anticipate that their transition to the next generation of princes will go smoothly within the decade. But the tide of liberalizing sentiment and media across the Muslim world is lapping at their door. Even an alliance with China can not insulate them from their own people's basic desires and the moderation or collapse of their supporting ideology.


Their export of Wahhabism increasingly falls on deaf and resentful ears. The capacity of jihadis to terrorize their enemies and gain ground against the infidel has been nullified in the face of massive and persistent opposition from the West, particularly the US. Their tactics have been repulsive. The Saudis can see the jihadi blowback happening in Pakistan, as carefully tended militants feel worthy of more than just being used in geopolitical games. The export of bigotry and jihad can only go on so long before the market is saturated and foreign attention falls back on its source.

The Saudi government runs extensive theological retraining operations (along with brutal prisons) to mitigate internal dissent/extremism, (defined in relative terms!). But at some point, they will surely put two and two together and address the problem at its internal source- the Wahhabi ulema and its ideology. Perhaps the Saudis will invite Richard Dawkins to set them straight on how improbable Allah really is. [That is a joke!]  Extremism won't go away entirely, but as in the days of Adbul Aziz, if it no longer is useful to its sponsors, it tends to wear out its welcome and be defunded and deflated. It is hard to believe that the legitimacy of the Saudi state will not over time become more dependent on the desires of its people than on Wahhabi fundamentalism, with or without the royals at the helm.

... And then a new savior will arise, leading a ragtag but fierce band of bedouin|fremen out of the sandy dunes to cleanse the licentious rot of a modernized and fallen Arabia|Arrakis ...


"This is what Keynes had always claimed: the market system lacked a thermostat and its temperature was likely to oscillate wildly unless controlled by the government."
...
"Rich countries should be making preparations for life beyond capitalism."
"It is clear that the Japanese economy is dual in nature. Their export-oriented manufacturing sector is highly productive because it competes in world markets. Its domestic service sector does not have to 'compete' in this way and can focus on other objectives that are of benefit to the Japanese people.
Like – maintaining high levels of secure employment with comcomitant income security.
Like – being nice to each other when transactions are required.
Like – being nice to tourists who bring them income.
The result from the conservative perspective – low productivity and waste."

Saturday, May 14, 2011

Artificial intelligence, the Bayes way

A general review describes progress in modelling general human intelligence.

This will be an unusual review, since I am reviewing a review, which itself is rather "meta" and amorphous. Plus, I am no expert, especially in statistics, so my treatment will be brutally naive and uninformed. The paper is titled "How to Grow a Mind: Statistics, Structure, and Abstraction". Caveats aside, (and anchors aweigh!), the issue is deeply interesting for both fundamental and practical reasons: how do we think, and can such thought (such as it is) be replicated by artificial means?

The history of AI is a sorry tale of lofty predictions and low achievement. Practitioners have persistently underestimated the immense complexity of their quarry. The reason is, as usual, deep narcissism and introspective ignorance. We are misled by the magical ease by which we do things that require simple common sense. The same ignorance led to ideas like free will, souls, ESP, voices from the gods, and countless other religio-magical notions to account for the wonderful usefulness, convenience and immediacy of what is invisible- our unconscious mental processes.

At least religious thinkers had some respect for the rather awesome phenomenon of the mind. The early AI scientists (and especially the behaviorists) chose instead to ignore it and blithely assume that the computers they happened to have available were capable of matching the handiwork of a billion years of evolution.

This paper describes, in part, a theological debt of another kind, to Thomas Bayes, who carried on a double life as a Presbyterian minister in England and as a mathematician member of the Royal Society (those were the days!). Evidently an admirer of Newton, his only scientific work published in his lifetime was a fuller treatment to Newton's theory of calculus.
"I have long ago thought that the first principles and rules of the method of Fluxions stood in need of more full and distinct explanation and proof, than what they had received either from their first incomparable author, or any of his followers; and therefore was not at all displeased to find the method itself opposed with so much warmth by the ingenious author of the Analyst; ..."

However, after he died, his friend Robert Price found and submitted to the Royal Society the material that today makes Bayes a household name, at least to statisticians, data analysts and modellers the world over. Price wrote:
"In an introduction which he has writ to this Essay, he says, that his design at first in thinking on the subject of it was, to find out a method by which we might judge concerning the probability that an event has to happen, in given circumstances, upon supposition that we know nothing concerning it but that, under the same circumstances, it has happened a certain number of times, and failed a certain other number of times."

And here we come to the connection to artificial intellegence, since our minds, insofar as they are intelligent, can be thought of in the simplest terms as persistent modellers of reality, building up rules of thumb, habits, theories, maps, categorizations, etc. that help us succeed in survival and all the other Darwinian tasks. Bayes's theorem is simple enough:

From the wiki page:
"The key idea is that the probability of an event A given an event B (e.g., the probability that one has breast cancer given that one has tested positive in a mammogram) depends not only on the relationship between events A and B (i.e., the accuracy of mammograms) but also on the marginal probability (or 'simple probability') of occurrence of each event."

So to judge the probability in this case, one uses knowledge of past events, like the probability of breast cancer overall, the probability of positive mammograms overall, and the past conjunction between the two- how often cancer is detected by positive mammograms, to estimate the reverse- whether a positive mammogram indicates cancer.

The authors provide their own example:
"To illustrate Bayes’s rule in action, suppose we observe John coughing (d), and we consider three hypotheses as explanations: John has h1, a cold; h2, lung disease; or h3, heartburn. Intuitively only h1 seems compelling. Bayes’s rule explains why. The likelihood favors h1 and h2 over h3: only colds and lung disease cause coughing and thus elevate the probability of the data above baseline. The prior, in contrast, favors h1 and h3 over h2: Colds and heartburn are much more common than lung disease. Bayes’s rule weighs hypotheses according to the product of priors and likelihoods and so yields only explanations like h1 that score highly on both terms."

So, far it is just common sense, though putting common sense in explicit and mathematical form has important virtues, and indeed is the key problem of AI. The beauty of Bayes's theorem is its flexibility. As new data come in, the constituent probabilities can be adjusted, and the resulting estimates become more accurate. Missing data is typically handled with aplomb, simply allowing wider estimates. Thus Bayes's system is a very natural, flexible system for expressing model probabilities based on messy data.

Language is a classic example, where a children rapidly figure out the meanings of words, not from explicit explanations and grammatical diagrams, (heaven forbid!), but from very few instances of hearing them used in a clear context. Just think of all those song lyrics that you mistook for years, just because they sounded "like" the singer wanted ... a bathroom on the right. We work from astonishingly sparse data to conclusions and knowledge that are usually quite good. The scientific method is also precisely this, (method of induction), more or less gussied-up and conscious, entertaining how various hypotheses might achieve viable probability in light of their relations to known prior probabilities, otherwise known (hopefully) as knowledge.

In their review, the authors add Bayes's method of calculating and updating probabilities to the other important element of intelligence- the database, which they model as a freely ramifying hierarchical tree of knowledge and abstraction. The union of the two themes is something they term hierarchical Bayesian models (HBMs). Trees come naturally to us as frameworks to categorize information, whether it is the species of Linnaeus, a system of stamp collecting, or an organizational chart. We are always grouping things mentally, filing them away in multiple dimensions- as interesting or boring, political, personal, technical, ... the classifications are endless.

One instance of this was the ancient memory device of building rooms in one's head, furnishing prodigious recall to trained adepts. For our purposes, the authors concentrate on the property of arbitrary abstraction and hierarchy formation, where such trees can extend from the most abstract distinctions (color/sound, large/small, Protestant/Catholic) to the most granular (8/9, tulip/daffodil), and all can be connected in a flexible tree extending between levels of abstraction.

The authors frame their thoughts, and the field of AI generally, as a quest for three answers:
"1. How does abstract knowledge guide learning and inference from sparse data?
2. What forms does abstract knowledge take, across different domains and tasks?
3. How is abstract knowledge itself acquired?"

We have already seen how the first answer comes about- through iterative updating of probabilistic models following Bayes's theorem. We see a beginning of the second answer in a flexible hierarchical system of categorization that seems to come naturally. The nature and quality of such structures are partly dictated by the wiring established through genetics and development. Facial recognition is an example of an inborn module that classifies with exquisite sensitivity to fine differences. However, the more interesting systems are those that are not inborn / hard-wired, but that allow us to learn through more conscious engagement, as when we learn to classify species, or cars, or sources of alternative energy- whatever interests us at the moment.

Figure from the paper, diagramming hierarchical classification as done by human subjects.

Causality is, naturally, an important form of abstract knowledge, and also takes the form of abstract trees, with time the natural dimension, through which events affect each other in a directed fashion, more or less complex. Probability and induction are concerned with detecting hidden variables and causes within this causal tree, such as forces, physical principles, or deities, that can constitute hypotheses that are then validated probabilistically by evidence in the style of Bayes.

A key problem of AI has been a lack of comprehensive databases that provide the putative AI system the kind of comon-sense, all-around knowledge that we have of the world. Such a database allows the proper classification of details using contextual information- that a band means a music group rather than a wedding ring or a criminal conspiracy, for instance. The recent "Watson" game show contestant simulated such knowledge, but actually was just a rapid text mining algorithm, apparently without the kind of organized abstract knowledge that would truly represent intelligence.

The authors characterize human learning as strongly top-down organized, with critical hypothetical abstractions at higher levels coming first, before details can usefully be filled in. They cite Mendeleev's periodic table proposal as an exemplary paradigm hypothesis that then proved itself by "fitting" details at lower levels, thereby raising its own probability as an organizing structure.
"Getting the big picture first- discovering that diseases cause symptoms before pinning down any specific disease-symptom links- and then using that framework to fill in the gaps of specific knowledge is a distinctively human mode of learning. It figures prominently in children's development and scientific progress, but has not previously fit into the landscape of rational or statistical learning models."

Which leads to the last question- how to build up the required highly general database in a way that is continuously alterable, classifies data flexibly in multiple dimensions, and generates hypotheses (including top-level hypotheses and re-framings) in response to missing values and poor probability distributions, as a person would? Here is where the authors wheel in the HBMs and their relatives, the Chinese Restaurant and Indian Buffet processes, all of which are mathematical learning algorithms that allow relevant parameters or organizing principles to develop out of the data, rather than imposing them a priori.
"An automatic Occam's razor embodied in Bayesian inference trades off model complexity and fit to ensure that new structure (in this case a new class of variables) is introduced only when the data truly require it."
...
"Across several case studies of learning abstract knowledge ... it has been found that abstractions in HBMs can be learned remarkably fast from relatively little data compared with what is needed for learning at lower levels. This is because each degree of freedom at a higher level of the HBM influences and pools evidence from many variables at levels below. We call this property of HBM's 'the blessing of abstraction.' It offers a top-down route to the origins of knowledge that contrasts sharply with the two classic approaches: nativism, in which abstract concepts are assumed to be present from birth, and empiricism or associationism, in which abstractions are constructed but only approximately, and slowly in a bottom-up fashion, by layering many experiences on top of each other and filtering their common elements."

Wow- sounds great! Vague as this all admittedly is, (the authors haven't actually accomplished much, only citing some proof of principle exercises), it sure seems promising as an improved path towards software that learns in the generalized, unbounded, and high-level way that is needed for true AI. The crucial transition, of course, is when the program starts doing the heavy lifting of learning by asking the questions, rather than having data force-fed into it, as all so-called expert systems and databases have to date.

The next question is whether such systems require emotions. I think they do, if they are to have the motivation to frame questions and solve problems on their own. So deciding how far to take this process is a very tricky problem indeed, though I am hopeful that we can retain control. If I may, indeed, give in all over again to typical AI hubris ... creating true intelligence by such a path, not tethered to biological brains, could lead to a historic inflection point, where practical and philosophical benefits rain down upon us, Google becomes god, and we live happily ever after, plugged into a robot-run world!

An image from the now-defunct magazine, Business 2.0. Credit to Don Dixon, 2006. 

"Greece should definitely leave the Eurozone."

Saturday, May 7, 2011

Free will- solved!

A theory of free will.

One of the perennial chestnuts of philosophy is the problem of free will. Mostly a problem for theists rather than non-theists, it still holds a few mysteries for everyone. Is our natural intuition of freedom true, that we reign as sovereign beings, maybe influenced, but never finally determined, in our choices? Or are those choices entirely determined, as the Marxists, physicists, and Tolstoy tend to think- by history, social conditions, the factors of production, character, genes, etc?

And if free will is an illusion, then what of morals? Can anyone be blamed for their choices? Can moral responsibility and agency exist without free will? This is surely the more interesting question.

The physical basis of life is now well-known, so if one assumes that our minds arise from the activities of our brains and, like everything else, are bound by physical principles, there is no escaping that free will really doesn't exist. Certainly there are theists who still believe in souls, supernaturalism, magical interventions in the evolutionary process, and the like, but without much cause aside from precisely the sort of intuitions that are better examined than taken at face value.

The physical world is causally closed as far as we know, and while that may or may not encompass the origin of itself in the pre-big-bang, it certainly seems to encompass our bodies and brains. So whatever we make of our feelings and agency, there is nothing we do or decide that could, on these physical principles, possibly occur without being the consequence of a train of prior causes & physical events. This means that we don't have what I would call "atomic" free will.

The quantum revolution throws a minor wrench into the situation, because the fundamental uncertainty it finds at small scales means that, however much we know, we can never predict where the full set of physical causes is going to take us. Everything may be caused by prior events, but that doesn't mean everything is determined to a singular fate, as Laplace tried to argue. Some of our prior events are truly random, and thus unknowable in advance. Yet that hardly gives us any more agency- it only leavens the causes that determine our decisions with a bit of comedic randomness.

Daniel Wegner wrote a very nice book about how our minds/brains nevertheless maintain an illusion of free will. For instance, if a person is (falsely) convinced that he did some act, he will typically spin elaborate post-rationalizations to explain its motivation to the interviewer. This is most strikingly true for people with neurological disorders, like split brain patients where one hand literally does not know what the other was doing. The verbal half of the brain will typically make up stories to rationalize what the disconnected half is doing. One can see similar things going on in the history of religion, where humans compulsively make up stories about literally everything under the sun that is mysterious. Many of which have had to be retracted, somewhat painfully, at times, or conveniently re-blessed as artistic myths.

More minutely, the work of Libet showed that our actions, and especially our conscious choices about them (like deciding to raise a coffee cup) are always preceded by unconscious trains of neurological activity. The choice is never de novo, but is itself a consequence of prior unconscious activities in the brain, and indeed comes to our consciousness- as a choice- well after it has taken place and set the physical events in motion. So consciousness is not sovereign at a very granular level either, but more of a caboose on the train, learning about things after they happen, more part of a feedback mechanism than of an action mechanism.

So we don't seem to have actual free will. Why do we feel like we are, nevertheless in charge when we hoist a glass to drink? At this point we have to ask the Buddhist/Hume question ... what is the self? Isn't it really an unending stream of causes, influences, and effects- our life histories caroming off our genetic and developmental inheritances? The deeper you look, the messier it is, to the point that a discrete "self" is undetectable. And the mess is mostly invisible, since only a tiny part of the mind's contents are conscious, and the far vaster unconscious activity rests on even more inscrutable molecular foundations. We simply don't know what is going on in our own minds, so can hardly be blamed for regarding it as magic, with the convenient (and, as always, narcissistic) assumption that we are master of this house.

Very well- free will is illusory. What consequences does this have for our moral and legal universe? This is where things get more interesting. For theists, aside from the convenience of off-loading the self into a god-like magical soul that, as they postulate, lives forever, the idea of free will also helps account for evil, since with God stipulated as all-good and all-powerful, there has to be someone else to blame: us, our original sin, and our darned free will to screw everything up!

For non-theists, of course, this angle is completely irrelevant. Yet still, the issue of blame reappears in mundane guise. If the self and the choices it makes are not sovereign, but rather inexorably caused by prior events, then how can anyone be blamed for anything? Doesn't morality become an empty joke?

Thankfully, the answer is no- it doesn't. The reason lies in another aspect of our programming, which is that we are not just physically-bounded no-free-will flesh-bots. We are physically-bounded no-free-will flesh-bots that can learn. Learning is the crucial ingredient in a moral universe, rendering us different from inanimate and non-learning beings. Do we blame rocks for falling on our heads? No we don't, unless we regard them as spirit-inhabited. Do we blame rabid dogs for biting us? No- they have lost their reason, and specifically, their ability to be trained (and we would blame their masters, anyhow). Do we blame insane people for murder? No, they get an insanity defense, because, crucially, they either don't know better, or are incapable of doing better. They are locked up securely rather than punished, because punishment wouldn't do any good.

And what good was punishment supposed to do anyhow? Ideally, (and I am not speaking of our current appalling penal system), punishment teaches the criminal a moral attitude, especially empathy, hopefully inducing deep personal change. Additionally, it has the exemplary role of teaching others the fate that immoral action leads to, as judged by the social system they share. It is a training exercise, which is exactly the sort of prior influence that comes back around to (hopefully) affect our future actions which, as we saw above, do not result from free will.

The (stricter) muslims cut a hand from the thief, which has all these salutary effects. Aside from significantly incapacitating the person from future thievery, it reminds him as few other punishments could of the social rules, and reminds all others who see it as well, influencing their future actions in turn. Unfortunately, its harshness also seriously impairs the society's claim to greater moral ideals and empathy, counteracting its training purpose.

 In so many ways- eating, gambling, drugs, advertising- we know very well we don't have free will. There is hardly a richer literature than that of the tragic battle against temptation and fate. And throughout history, (including that of religion), we labor on, seeking social power and influence to defend others from temptation and bend others to our ideas of human betterment, descended as they are from, to paraphrase Keynes, some defunct philosopher. "Free" has nothing to do with it, but learning and mutual social influence certainly do.

We live in a matrix of influences and prior events. We are built as social beings to give and receive these influences, wired for empathy, for conversation, and inspiration. We cultivate each other and ourselves in a constant effort to attain our overall goal, on which our unconscious and conscious minds are in full agreement- increased happiness. The moral landscape is just another word for that mutual cultivation, on which everything depends.


  • A blogging friend writes about punishment and its moral role, coming to a similar point from a very different direction.
  • Predator drone court-martialed for killing civilians.
  • Salman Rushdie chimes in on Pakistan.
  • Slate breaks the existence of SEAL cats.
  • The case for negotiation in Afghanistan, such as it is.
  • A book for those interested in Christian-ized histories of early America.
  • A brief guide to dark matter.
  • Software toys with human perception and locomotion.
  • More in the annals of class war, and then some more.
  • A dark age of economic dementia.
  • Bill Mitchell quote of the week (from Charles Ferguson), on the credibility of economist Martin Feldstein:
"Martin Feldstein, a Harvard professor, a major architect of deregulation in the Reagan administration, president for 30 years of the National Bureau of Economic Research, and for 20 years on the boards of directors of both AIG, which paid him more than $6-million, and AIG Financial Products, whose derivatives deals destroyed the company. Feldstein has written several hundred papers, on many subjects; none of them address the dangers of unregulated financial derivatives or financial-industry compensation."

Saturday, April 30, 2011

It is just the same old class war

To get where we want as a society, free labor markets and trickle down economics are not enough.

(My apologies for a lack of editing...)

The attack on unions in Wisconsin and on workers in general by the Republicans brings up a very basic issue- why do unions exist? Do we still need them? What might succeed them?

Unions originated in an effort to redress the inhuman conditions of gilded age sweatshops, factories, and mines. After a long and bloody fight against management and the government in the late 1800's, the US political system (under progressives like Theodore Roosevelt and Woodrow Wilson) came around to the view that perhaps unions weren't as bad as ... a communist revolution! That spectre has now receeded, and so likewise has the political aquiescence by the upper classes that enabled unionization.

Why was unionization needed anyway? Wasn't the magic of the free market enough? This is a key question as we head into another era where free markets (even "freedom") are fetishized, where unions are withering, (and weirdly castigated as more double-unfree than corporations), and where the same Darwinian dysfunctions, whose principal fruit is gross income and wealth inequality, are striking at the heart of the American dream.

One would think that at this moment in the US, when upward mobility has slowed to a crawl, when income and wealth inequality has risen to guilded age heights, and following a cataclysmic financial meltdown created by FDR's "malefactors of great wealth", the political tide would have turned towards a new socialist or at least worker-friendly ethic.

But apparently not ... the rich have doubled down on greed, harnessing the now-private media and the lie of federal insolvency to hobble the government just as soon as it finished the important work of keeping financiers afloat and their own nests feathered. Homeowners and workers? The teaparty cynically deploys the rhetoric of freedom to erode all values but individual greed, breaking the social bonds that are embodied in social security, decent health care, and universal employment, among much else. As if economic insecurity equals freedom.

For at the bottom of this new callous age is the matter of unemployment. Unemployment is not an economic problem. Economies can get on just fine with an invisible mass of those who neither spend nor earn. Indeed, the unemployed have their uses in taming workers from raising their voices, defending their dignity, and bargaining for better pay. It is also one way to reduce inflation, though there are other, better ways.

Unemployment is a moral problem, and needs to be addressed as one. It exemplifies why free markets fail us in important ways, requiring remedies from our political community- the government. Over the last three decades, however, government policies have all tended in the opposite direction, eroding common purpose in favor of the "freedoms" of private capital, where fundamental assymetries are at play.

The last three decades can be seen as an extended attack on labor bargaining power, under the theory that labor empowerment leads to inflation (by the Phillips curve, NAIRU, and similar relations). After the high water mark of the 70's, the idea was to bring discipline back to the labor market at the same time that discipline was brought to the monetary system. Very well- inflation is now practically zero. Labor has been tamed in innumerable ways- weakening and breaking unions, allowing persistently higher unemployment via monetary policy as the chosen mechanism to lower inflation, competition with globalized, illegal, and offshored labor. Are we a better country for it?

This process has had the effect of bringing back a gilded age, where labor bargaining power is very low, companies can use the excess earnings as they see fit- either enriching managements, or paying shareholders, or engaging in takeovers and empire-building, reducing competition, or corrupting the political system. Corporate profits are at an all-time high, while corporate contributions to the common good, via taxes, are at an all-time low. The amount of money that is floating around, due to the ever-rising productivity of workers, is mind-boggling. But none of the productivity gains of the recent decades went to workers, due to the steady erosion of their bargaining power.

Now we stand at the nadir of this process, after the financial class engineered the spread of indebtedness through the lower classes to the point of insolvency, created harsher bankruptcy laws just in time, and secured government bailouts for their own positions. Management now, through the magic of epic unemployment and associated misery, has maximal power to gain wage concessions, cut benefits, and entrench their position ... unless there is a political response.

Aside from the direct misery it has entailed, this process has wasted labor on a epic scale, reduced aggregate demand on a permanent basis, and cut into the very foundations of the productivity the upper classes rely upon unthinkingly- our education system, research establishments, public infrastructure, and regulatory apparatus. And when a Democrat has the audacity to point out this gaping inequality, its pernicious effects, and its obvious solutions, the moneyed interests have the gall to cry "class warfare!" At least in ancient times, the rich had the good manners to provide public goods in return for their good fortune, like temples, stadiums, alms, and armies.

It is a sad and downward spiralling story, taken by the GOP as some kind of weird mantra- the need to destroy what we as Americans have spent a century and more building up. This is how empires collapse- through the self-generated dementia that takes for granted what led to greatness, and latches onto the most superficial and moralistic patent remedies for complex problems whose appreciation requires deep intellectual engagement.



Returning to the question of unions, they are hardly an ideal solution, being maddeningly sporadic in their effectiveness, and leading to excesses of their own. Unions have plenty of problems, even as they have successfully increased worker dignity and benefits- for their own members, and in many cases for all workers. Making decent treatment of workers dependent on the idiosyncrasies of union organization and industry setting is messy and unfair, so as successes have come, (and industries have not died as they claimed they would), the US political system generated various universal regulatory and economic rules that extended benefits first won by a few unions.

So workers are treated better now in most settings, being killed at lower rates in sweatshops, mines, slaughterhouses, oil rigs, and cubicle farms. But how are they doing in economic terms? Not well at all. As has been mentioned, the income share going to workers has declined for decades. Real incomes for the lower and middle class have been stagnant, while the economy's enormous gains in productivity have gone almost entirely to the wealthy in the form of high incomes and profits.

The economic function of unions has not been taken over by the state. Rather, it has withered. One of the principle successes of the labor movement- and of public policy in general- in the mid-twentieth century was establishing Keynsian economics at the core of federal economic policy. This was the decisive answer to the Great Depression and to Bolshevism, enshrining full employment as a primary goal of state policy, and state monetary and fiscal policy (via the Federal Reserve) as one way to accomplish it.

This great accomplishment is now withered husk. The recent financial crisis showed the upper classes feeding at the trough of a fully coopted government, (tax cuts, financial bailouts, bonuses with contract "sanctity"), while giving hardly a fig for either the unemployed or for the low-income homeowners and other debtors fraudulently ensnared in boom-time predatory lending. The Federal Reserve has showered money on banks, while only grudgingly revising credit card and real estate lending rules to modestly reduce the financial industry's rapacity. Now it claims nothing more can be done.

More importantly, unemployment, far from being the goal of Federal Reserve policy over the recent decades, has become the tool of a policy that is entirely focused on inflation reduction. Unnecessarily high unemployment and underemployment were in place long before the current great recession, and have systematically biased the labor market towards employers. This is the real story of our economic epoch, that a return of economic laissez-faire, at the hands of an economics profession besotted by mathematical models and false (indeed, pathological) behavioral models, as well as the usual moneyed interests, has put capital back in the driver's seat, and labor in the trunk.



Why don't labor markets work to correct this? What is the problem? First is that, in the presence of chronically tight policy by the Fed, (currently rendered defunct by deflationary forces from our own collapse and from abroad), labor markets, as noted above, strongly favor employers over workers. Tight money keeps economic growth sub-optimal, maintaining a reserve army of the unemployed. Imagine an ideal world where job offers are routine for anyone interested and capable of working, where training is understood as a part of employment, and where pay at the low end is rising, in aggregate, in step with worker productivity. That is a full-employment economy, and sustaining it with low inflation is the aim of Keynesian and more recently of MMT economic theory.

Second is the overall structure of labor markets and wage negotiation, which are woefully inefficient. Pay scales seem to have a great deal more to do with class and lifestyle expectations than with accurate competitive or market-based mechanisms, let alone metrics of true worth. If executives have the expectation that their janitors are blue collar and share support of their families with working spouses, then the pay offer will be commensurately low. It will be a subsistence wage at best (or less if various federal subsidies are counted in and off-loaded; medicaid, school lunches, food stamps, earned income tax credits). If they have the expectation that their accountants are white collar with higher personal lifestyle expectations, the pay offered will be higher, even if there are plenty of accountants to chose from. Pay is nominally set by market surveys and other peer-influenced methods, but in the end, it is an intuitive matter for the executive- a way to maintain a social hierarchy in the workplace that is culturally recognizable and traditional.

Neoliberal economics proposes that there would be a premium on pay for unpleasant or dirty work. But we see the exact opposite in the real world. Unpleasant and dirty work is paid the absolute least, and why? The conventional argument is that it is unskilled, so the market supply of laborers is high, thus the pay is low. But The supply of financial professionals is very high right now. Are they paid blue collar wages, as they should be? No, you will not see that happening. Blue collar work marks itself as lower-class, and is for that reason low-paid.

Neoliberal economics proposes that higher pay would increase supply of work. But we see the exact opposite in the real world, where those getting low pay work at least as hard, if not harder, than those paid far more. And those paid the most are most free to quit, retire, and take up golf instead. If pay is zero, there are still people willing to intern, to volunteer, and indeed to do extraordinary amounts of work that they are emotionally committed to. Conversely, if pay is very high, as is common in the financial industry, workers often work just long enough to buy their house and "make their nut", retiring and withdrawing their supposedly highly valuable skills from the workforce.

The conventional theory would respond that higher-paid work is more valuable, in terms of corporate needs, than low-paid work. But the financial crisis put that myth in a somewhat new perspective, both for the companies involved, and for society at large. How does one measure value, and do executives typically do a good job of it? I would suggest that wage value is one of the most subjective decisions one can make, and is unconsciously freighted with all sorts of non-economic factors, like ... gender, likeability, similarity to one's self, dressing habits, paper credentials, ... one could go on and on. A common denominator is ... class, class, class. Socioeconomic class seems to me to be the leading ingredient in the pay scale decision, since what else do we have to fall back on, once the dream of rational economic valuation of labor turns out, as it inevitably will, to be impossible?

But when has pay for labor ever represented a purely economic transaction? Isn't what we are paid a measure of what we are "worth" in more than economic terms? Aren't the über-executives competing for stratospheric pay- which eventually has to be given away- really competing for something more than their relative economic contribution to shareholder value and long-term company growth? They are competing for status of the most crass and uneconomic kind, and are hardly shy about crony-ing or embezzling their way to this "valuation".



So, unions are one way to address some of these issues, reeling in the pay structure from its various current dysfunctions. I'd address the patchy nature of their benefits by instituting unions as a mandatory part of normal corporate governance. Each company would have a worker's board, have one representative from that board on the main board, and these would collectively bargain for pay and work policies as standard practice. Books would be open, so information assymetry would be minimized, and a standard rate of profit sharing would be established by cultural convention or law between the stakeholders- management, shareholders, and workers. These unions would, however, not be allowed to band together into industry-wide or other forms of cooperation, unless companies were allowed to as well, keeping the parties evenly matched.

Secondly, the minimum wage needs to be raised to realistic levels so that it is truly a living wage. The US should not allow employers to run sweatshops and off-load the true cost of labor to the government in the form of safety net programs for working people. Truly low-wage work is better left to other countries.

Thirdly, we need a more worker-friendly macro-economic policy that returns us to a high employment environment, thus naturally putting workers in a better bargaining position in a free labor market. The MMT school of economics claims that we can have a looser economic policy on an ongoing basis- that for various reasons of ideology, theoretical error, and forgetfulness of Keynesian principles, we have had a chronic bias towards tight money that has led to the chronic underemployment, economic underperformance, and the growing wage / wealth disparity we see today.

This school also promotes the idea that, monetary policy aside, we can institute full employment directly as government policy, by offering state-sponsored minimum (living) wage jobs in public service to every able-bodied person as a replacement for the paraphernalia of the means-tested system- the supplemental income tax credits, the welfare, the food stamps, unemployment insurance ... all of it. People do want to work, and deserve to be treated and paid fairly for it.

A fifth pillar would of course be a restoration of progressive taxation, which has so eroded over the last decades that the richest corporations pay little or no taxes at all, and the richest people less than other brackets, while gathering enormous political and media influence to entrench their position. Has all this tax-cutting and CEO worship made us more prosperous? Only if you drive a yacht. It has not trickled down, or enlarged the pie, or improved our civic or political atmosphere. The current Republican plans to further enrich the rich while destroying public goods are thus not just callous, but economically destructive, culturally destructive, and dangerous to our common future.

Conservatives are beginning to speak of American "decline"- worries about economic, cultural and strategic decline, not just in relative terms as other nations like China follow a modernizing path in our wake, but in more profound terms that something is not quite right within our system. They blame the usual suspects- the 60's, immigrants, government regulations, civil rights, taxes, Obama. But into the mirror is where they should be looking.

"Additional reports about the meeting allege that Pakistani prime minister Yousaf Raza Gilani told Afghan president Hamid Karzai the U.S. strategy in Afghanistan was failing, that China is an ascendant power, and asked that the insurgent Haqqani network be given a political role in Afghanistan as part of a peace settlement."
"The point is that if the US Congress follows Bernanke’s advice to make deficit cutting the priority, then these projections will not be achieved. As they stand – they lock the US labour market into an unacceptably high unemployment situation for the next several years.
Bernanke offered no clue as to how deficit reduction will also be consistent with those projections. He failed in his main task."

Saturday, April 23, 2011

Thoughts in, memory out

Researchers find memory signals coming out resemble the reverse of sensory signals going in.

While the greater problem of the physical basis / nature of consciousness is pending on the scientific to-do list, the problem of how memory is stored continues to yield to persistent experimentation. A long history of lesions in human and animal brains has told us where memories are stored and in part how they are routed through the anatomical circuitry. Also some of the molecular and cellular details have come to light- that synapses are the typical location of storage, getting strengthened by use (with the possible addition of new cell growth and new cell extensions) in ways that are thought to promote their ability to join in activity patterns that resemble the encoding pattern, and thus enable the recall of memories in response to relevant cues.

The current paper takes this work a little deeper, using detailed recording of small brain areas to test whether this theory is really true- whether sensations fed into local neural nets actually resemble memories that the experimenters later prompt from those same areas. Given the distributed and stochastic nature of neural processes, (which we can sense in the muted and fragmentary nature of our thought and memory patterns), looking at this on the cellular level requires a good bit of statistics to sift signals from the data.

Our brains have two general tissues- the gray matter and the white. The white matter is white due to the preponderance of myelin, the fatty insulation wrapped around long-distance nerve fibers (axons) to enhance their conduction. It is the piping of the brain. The gray matter consists of a large sheet of cell bodies and cell-cell connections (dendritic spines, arbors, and synapses) layered on the surface of the brain which, if one conceptually irons out the convolutions, extends to a surface of about 0.25 square meter. The gray matter has a depth of between 1.5 to 4.5 millimeters.

A small area of the brain, stained for cell bodies, (purple), which accentuates the gray matter and its layers.
The layers within the gray matter have been recognized for over a hundred years, and are important signs of anatomical and functional differentiation. Typically, there are six recognized layers, most of which correspond to different classes of neuronal cell bodies, from which axons and dentrites branch out to the other layers in a dense network. Functionally, the layers interconnect more strongly up and down than they do to neighboring points in the gray matter sheet, so functions tend to map over the sheet like states on a map, where neighboring "columns" projecting down through the six-layer sheet have related, but different functions. In the visual cortex, for instance, nearby columns of roughly 50 micrometer diameter may alternate which eye their input comes from, or compute (i.e. be specifically sensitive to) directions of object motion or orientation around the cardinal directions in a progressive fashion.

The present researchers concentrate on the vertical structure of a small portion of the macaque temporal perirhinal cortex (bottom middle side of the brain). This location (area 36, to be precise) is known to be the end of the line for visual sensation, after the extensive processing that happens in earlier portions of the visual cortex. (Interested readers might refer to Christof Koch's book the quest for consciousness, which focuses mostly on the visual system.) It is also close to the hippocampus and interacts with its memory functions. It is where visual memory is stored.
"The primate inferotemporal cortex locates at the final stage of the ventral visual pathway and serves as the storehouse for visual long-term memory."

The heart of this paper is the use of dense electrode arrays which the researchers stick into the brains of their macaques before doing behavioral experiments with them. These arrays have 24 sub-electrodes, spaced 100 micrometers apart vertically, to give a rough picture of what is happening in the different gray matter layers at one point of the macaque visual memory cortex. The researchers attempt to show that the direction of current flow/processing tends in the opposite direction (up vs down) though this layer as the macaque switches from seeing a visual figure to recalling it from memory. They do this with two data reduction methods called current source density analysis (CSD), and cross-correlation analysis of spike trains (CCG, for cross-correlogram). Some faith is required from the reader in the author's treatment of their data.

Readings from these electrodes were timed with respect to the task given to the macaques, either presenting them with a picture, or asking them to recall a picture, and the relations between the vertical levels of the gray matter activity are read out and statistically analyzed. For instance, the earliest signals seen in this region after presenting a picture to the macaque were in the layer 4, consistent with its known connections to upstream visual components.

Gray matter layers SG (supragranular), G (granular), and IG (infragranular) are also termed layers 2/3, 4, and 5/6 respectively, as shown. The outside surface of the brain would be towards the bottom. The asterisk marks where the first signal arrives, after the cue picture is presented.

The macaques had been trained to associate six pairs of images, so that seeing one (for 0.5 second, called the cue period) evoked the other one from memory, which they touched after a 2 second delay period, out of a few choices, on a test screen (1.5 second choice period) for a reward. After training and by the time of the experiments, the macaques got these tests 90% correct. I would have to comment that it is not absolutely clear from this protocol that the macaque was driven to internally visualize the missing picture from memory, only to dredge up a matching sensation once the matching image was explicitly shown. The key data was taken during the delay period, however, increasing the chances that they were dealing with a memory prepared by the macaque in advance for rapid test success.

Schematic of the images presented to the macaques as cue and test.

The results from all this are extremely subtle- slight shifts of current direction that tell us that data (i.e. neuronal spikes or current) is transiting between strata of the gray matter. The authors represent this in several ways, first of which is a graph of spike train correlations between two locations, in this case the IG and SG layers, tracked during the cue period where there the slight shift of correlation indicates traffic from the SG to the IG layers, and the delay period where the opposite is the case- traffic from the IG to the SG layer is indicated.


All this is summarized in another series of graphs (below), mapping everything happening in the layers they sampled. The X-axis is the deduced source layer, and the Y-axis is the deduced target layer, in mm, with the G layer (4) at 0. The red spots then map the source-target pairs, which are finally summarized at the right as the traffic during seeing (cue) and recall (delay). Obviously, there is a great deal of noise. We are only evesdropping on a few cells in the vast structure of the brain that may or may not be terribly central to the picture the monkeys are trained on or being shown. The researchers don't really say whether they had any guidance other than the known anatomy, like functional MRI or the like, to locate the gray matter regions that would be optimal for this analysis. In all likelihood, they poked several likely places and said a few hail Marys.

Part A is described in the text. Part C summarizes all the data, describing where signals are going within the gray matter layers of the perirhinal cortex during visual perception (cue) and presumed memory retrieval (delay).

Do they have anything to say about prior knowledge about what the layers are known to do?  They cite some reviews, including an excellent one which discusses in detail the parallel processing that goes on through the visual system, (progressing from the back of the brain in a forward direction), and notes specifically that early (V1) visual processing typically takes the same interlaminar path of G/4 to SG/2/3 layers, corroborating what the current researchers find in the much later portion of the visual system. So the G -> SG layer sequence, among much other processing, may be a general property of incoming sensory information throughout the gray matter.
"The present study demonstrated that canonical feed-forward signal flow across cortical layers during sensory coding reverses to the feedback direction during memory retrieval phase, which suggests flexible recruitment of interlaminal connectivity depending on the cognitive demands in the monkey association cortices."

So, assuming that these macaques are really generating image memories while they wait for the test to take place, (delay period), and that the memory, if not identical to the perceived pattern since it is a different learned pair image, at least uses the same physical mechanisms and locations, these measurements suggest that visual memory generation resembles a reverse of the process of visual perception at the latest stage. This has obvious appeal as a simple and efficient theory of how the brain works, where an executive level of control/attention has only to ask (implicitly) for a memory, and those regions of the brain responsible for perceiving it in the first place cough it up on demand by a sort of reversal of the storage process.

I might add that the vividness of such a memory is a very interesting question. For these macaques, there needed to be no vividness at all- the entire recollection could easily have been subconscious, so as to enable quick test performance, but not to do a full LSD-style re-visualization. This would only require a small recurrent (i.e. backward) request from the executive attention (or sub-attention) area to this very last area of visual processing / memory. However, the idea of recurrent requests of this kind and the "spotlight of attention" in general is a hot topic, and it is increasingly clear that attention mechanisms can reach very deeply back into the perceptual processing structures, enabling many levels of re-enactment of a remembered stimulus.
"We found that information about where attention was allocated can either originate in posterior cortex (when grabbed by external cues) or frontal cortex (when being internally directed)." - from the last link presented, about how attention happens in the brain