December 14, 2007

Downes responds

Stephen Downes left the following comment to my last post. It's a good comment so I'm going to pull it up front so it'll be easier to read. It's unedited, except for a quick spell check (I know the perils of the blogger comment system):

Interesting and useful discussion. Some comments:

We need to be really careful about how we describe the contents of memory.

There is a tendency to think of mental contents as resembling objects. Things that look like sentences, say, and that can be stored and retrieved, like data in a database.

But when I say (to cite your summary) "Knowledge means having a certain organization of neural connectivity such that you can recognize certain patterns in the environment" it is important to see that the *organization* constitutes the knowledge, and there are no 'objects' that are stored or retrieved.

When we contrast that with Kirsher's view (again using your summary), "Knowing something means being able to quickly recognize and retrieve it from your long term memory in response to some stimulus," you can see that there is a significant contrast between the two positions.

This makes a significant difference in how one views instruction and learning.

Let me elaborate. You write:

"Then Downes states that learning is not having things pushed into your head but growing and developing in a certain way such that you recognize certain patterns. If by this Downes means that teachers cannot induce learning, I would disagree."

The choice of the phrase 'induce learning' is very precise and no doubt deliberate. It made me think at once of induction coils, which offers a useful analogy to illustrate my point.

For those unfamiliar with electricity, 'induction' is the generation of an electric current in a conductor by passing it through a magnetic field. Such a field can be produced by a coiled conductor. See the picture here: http://micro.magnet.fsu.edu/electromag/java/faraday/

Now the important thing here is that the electrons in the first coil never enter the second coil. The production of the current is entirely via the magnetic field. The first coil *induces* electrical current, but does not push electrons (or anything else) into the other wire.

Now there are obvious differences between human memory and magnetic induction, but you can see here that I can show how a teacher could 'induce' learning without actually 'pushing' facts into their memories. And, indeed, teaching is like induction.

What this illustrates is how you can't just 'produce' learning in a student, no more than you can induce conduction in a non-conductor. And learning in the student isn't something the student 'received' from the teacher, but rather, a new alignment into which the student shaped him or her self as a result of the teacher's influence.

This view is very different from what Kirshner appears to think about learning, based on his examples and phraseology. When Kirshner talks about 'search' and 'retrieval', he is very clearly employing a 'knowledge as object' perspective, one that is quite misleading.

What is also worth noting is that the 'induction' effect (to give it a hand name) is not unique to teaching. Thus, when you say "the literature is replete with experiments showing that learning can be accelerated by the use of good teaching" there is no reason to disagree - since it is obviously true - but to point out that the *explanation* of this phenomenon may be unclear.

Students learn through exposure to perceptual phenomena (there is, indeed, no other way), and teachers are but one source of perceptual phenomena. Students can learn from nature, other students, reading - a wide variety of phenomena. What is important, of course, is how the experience is shaped (much in the way the magnetic field is shaped) and what sort of influence it has - determined as much by the nature of the student. You cannot create a current in a non-conductor, for example.

So, to be precise: teachers do not implant knowledge in their students. They, a best, induce it. And this process of induction depends as much, if not more, on the nature of the student, as on the nature of the influence.

To turn to a different subject, you write, "It does not follow from Downes' definition of learning that an "authentic community of practice" is needed to form the desired neural connections."

Quite so. I would not say that an authentic learning community is necessary in all cases. Nor would I say that it is sufficient in all cases. The question is rather framed around the question of how best to create, shall we say, the most conducive (conductive?) environment.

A teacher is but one element in an environment. Like it or not, a student's peers, his or her parents and pets, the walls of the buildings, local media including Internet connections, and the rest, all form a part of that environment. If this environment is consistent and conducive to a certain type of learning, then this type of learning is more like to occur (depending, as always, on the nature of the student).

(By 'nature of the student' I am not referring to the student's innate properties, but rather, to the current constitution of the students - his or her health, thoughts, prior beliefs, and more).

You write, "I might be able to learn physics the long and hard way by conducting thousands of experiments like the great discovers did, but its much quicker and easier to learn the same things by reading a physics textbook prepared by an expert in physics."

Quite so. But could you learn to become a physicist without interacting with a community of physics?

Knowing 'physics' isn't just the accumulation of a set of facts. It is, again, to be shaped a certain way - 'knowledge', as instantiated by a series of connections, is not just the set of facts, but also the way of thinking, the way of acting, way of evaluating. It's very hard to do without relevant experience of people who think and act and value things in that way.

None of this says that someone *cannot* learn outside the community. You can get a sense by reading - much of my own background in the sciences comes from reading science fiction, and Kim Stanley Robinson's recent 'Forty Days' series illustrates the way the thought processes of the scientific mind. But, all things being equal, immersion and direct experience are more likely to induce the expected learning than reading or telling.

Finally, "All of this occurs in the first seven minutes or so."

Quite so. It is important to note that in this talk I offer only a short summary of connectivism.

Now, on to perceptions, "Downes seems to think that the connectionist theory conflicts with Kirschner and instructivist learning."

I need to be clear here, it is Kirshner who is finding the conflict. Kirshner is very clear in his paper that his theory shows that all the other theories - discovery based learning. inquiry learning, constructivism - fail (in fact, that's the *title* of his paper).

What is more important to me is showing that these theories do not fail than showing that they contradict Kirshner. But the route to this lies through kirshner, and specifically, the misunderstandings of both cognition and scientific method that his own papers presuppose.

I would point out, to change subjects, that my response to Kirshner is being mischaracterized in places. For example, you write, "For example, Downes characterizes Kirschner's position as being that non-instructivist teaching results in no learning."

I do not say this, am in fact careful to use Kirshner's own phrasing when I make the relevant statements. Kirshner argues, very clearly, that non-instructivist methods result in no better learning than direct instruction, and sometimes in *less* learning, because of the 'cognitive overhead' required in self-directed methodologies.

Kirshner's argument on this point is not based on experimental data, but rather, on his theory of cognition. Specifically, he argues that short-term memory has a limited capacity, and that if some of this capacity is not available for new facts (because it is taken up 'selecting scientific principles') then the transfer of information to the student is reduced.

I respond to this argument by showing how Kirshner's theory is false. We do not 'retrieve theories' into short term memory and then 'select' from them. That is not how thinking works; that is not ow scientific thinking works. And therefore, Kirshner's argument, on these grounds, against student-directed learning, fails.

(As an aside - I am very familiar with, and sympathetic with, Kirshner's line of reasoning. t is the sort of thing faced by students of mathematics or logic. Supposed, for example, you are posed with a statement, 'All S are P', and asked whether 'Some non-S are non-P' follows. Typical logic problems require that the student pick a theory - contraposition, obversion, etc - and work out the inference. Picking the correct theory is an annoyance. better just to see - suggests Kirshner - an instructor work through the example. The problem is, Kirshner is mischaracterizing the nature of scientific problems and how they are solved. You need to *recognize* the right sort of approach. I once created a 'categorical converter' which explicitly draws out the network structure of categorical inferences. This is what needs to be emulated - but the only way to get to it is to begin to think like a logician (or, like me, to be really persistent and to eventually draw it out for yourself)).

To continue, "The standard position is that non-instructivist teaching often results in less efficient learning, the probability is increased that incorrect learning occurs, it favors those with more background knowledge. These are the standard criticisms and Downes does nothing to refute them, choosing instead to attack a strawman."

Again, I think if you go back and look closely at my refutation of Kirshner, you will find I am very careful to avoid that straw man.

Now let's turn next to a new issue. You write, "Downes leaves out the feedback loop, testing, which is needed so that the teacher can make sure the student has actually learned from the demonstration/model presented."

This is not quite correct. I identify four types of associative learning, one of which is 'back propagation'. Back propagation is a term from connectionism, a branch of computer science. It constitutes essentially a feedback mechanism for neural networks.

But 'feedback' is, of course, very different from testing, and the purpose of feedback is not "so that the teacher can make sure the student has actually learned." Feedback is a corrective mechanism, intended to send new information back into the network, causing it to alter the nature and strength of its connections.

The question of how learning is demonstrated is a very different question. It is not directly the subject of dispute between Kirshner and myself (I don't actually know his views on testing).

My own view of testing, in brief, is that it is like using a hammer to find out if something is a nail. It sometimes works. But it can mislead, and it can produce harmful results.

The best mechanism for demonstrating knowledge is not likely the production of a certain set of facts on demand. Expertise in a discipline on the part of a student is something that is typically *recognized*, not measured, by people who are already experts in the field.

But this is very much a side issue. testing is not a part of learning itself - indeed, the vast bulk of what we know is stuff we were never ever tested on. testing is an administrative process, intended to govern the allocation of resources and certification and credit.

To look at what you say is "the procedure they use for Direct Instruction," you state that the 'lead' step is optional, but in Kirshner's work, the 'lead' step is very much not optional, and is, according to him, the direct cause of the lessening of the learning.

Let me also grab a snippet, to introduce yet another matter. You say, in part, "...Direct Instruction, a pedagogy I'm sure Downes is four-square opposed to, yet which oddly enough is fully in accord with his definition of teaching and learning."

The presumption, "I'm sure Downes is four-square opposed to," may be the result of jumping to conclusions. I have never expressed opposition to direct instruction (uncapitalized) in my work. I take part in direct instruction myself, both in learning and in teaching. However, where I differ greatly from many others is that I believe that the process of direct instruction needs to be initiated by the student, and not imposed as a part of a required curriculum or instructional method.

As I said before, the ability to learn depends on the nature of the student. When the student is motivated to learn, when the student is in a specific frame of mind, when the student has the requisite background to know what (and what kind) of knowledge is needed, then direct instruction is very effective.

Simply putting a bunch of students in a room and 'direct instructing' them on mathematics will produce some results (generally, some improvement in mathematics), but is a wasteful and disempowering way to approach learning, particularly when compared to how much they could be learning in a wide range of subjects (not just mathematics) in the same time.

You state, "Learning is greatly dependent on the quality of the demonstration/model."

Yes, but in what does this quality inhere? There has been a lot of discussion about what constitutes 'quality' in teaching, but I would think that it's a mistake to look for quality only in the teacher.

The models and demonstrations in fact come from a wide variety of sources - teachers, co-students, parents, media, more. The best example in the world, the best teacher in the word, can be effectively undercut by other elements in the environment.

This isn't the place for a lengthy discussion of how best to provide 'quality' in the environment as a whole. I think it will do for now to suggest that there is such a discussion that could be had, and that 'quality' constitutes more than just 'quality performance by a teacher'.

With this in mind, let me address directly "The problem with most teacher presentations, as I pointed out here, is that they are usually fraught with ambiguities. Let's use the ambiguous glerm example. Some students will walk away from the demonstration thinking that glerm means rectangle or purple, instead of vertical, and may labor under that impression for quite some time."

It is interesting that you use this example. It seems to be drawn either from Quine's 'gavagi' (on the indeterminacy of translation) or Goodnam's 'grue' (on the indeterminacy of projection). The two are fundamentally the same.

This is one of the reasons *why* I say that knowledge is constituted of connections, rather than sentences or propositions. The 'gavagi' and 'grue' poblems are inherent in the nature of language and inference; they are the rule, not the exception.

True, insufficiently imprecise teachers are a problem - people in general are very sloppy with their language - but the problem is not simply the quality of the teacher. In the right context, there would be no issue whether the teacher meant rectangle or purple (if the child was taught, or read at home, that this is what the word means, for example). In other cases, the teacher must move slowly, with clarity and precision.

But, again, imprecision is not the sole issue. The same sort of imprecision that causes no problem at all on the playground or in the bar with your friends cannot be blamed for the failure of learning to occur.

That said this, then, creates what is in fact one of the most common arguments against associationist theories in general: "Using Downes connectionist theory we know that this student's brain is going to connect itself up so that the pattern for glerm is associated with purple or rectangle, all of which will have to be undone when the student finally learns the right meaning of glerm."

Quite so.

But my response, here (just as it is against Chomsky's prety of the stimulus argument) is that the precision presumed in the objection never existed in the first place.

This, obviously, is a discussion that could continue at some length.

But we really have to be careful.

Take this statement: "We also know that it takes many more repetitions to learn something that has been mistaught than it takes to learn something new."

Well, no. We need to say, "it takes many more repetitions to learn something that has been misLEARNED." Because there isn't a direct (deductive, simple-causal) connection between what is taught and what is learned. Something can be taught correctly and learned incorrectly; something can be taught incorrectly and learned correctly (that's how I learned grammar!).

Another matter, "the misunderstanding of instructivist teaching as comprising mostly rote learning," does not form part of my argument (nor Kirshner's) and so is a bit of a distraction from what I actually say.

The example provided of mathematical learning bears very little resemblance to what I would actually say. We could look at this in more detail, if you like. But, again, it's a common argument (based in the work of people like Chomsky, Fodor and Pylyshyn) that we must use rules to manage any rule-based domain, such as mathematics or language. My response, as before, is that the nature of a 'rule' in a network-based system is different than the nature of a 'rule' in a formal system (a difference Kripke tries to mask in his treatment of Wittgenstein on rules and private language.

As a result I think that your conclusion, "Constructivist pedagogy merely differs from the instructivist pedagogy in that the constructivists set up an environment in which it is hoped that the student discovers the general rule on his own with as little guidance by the teacher as needed," is incorrect.

As I state above, doing something like mathematics or science simply isn't a mater of 'finding' a rule.

It doesn't involve 'general rules' (properly so-called) at all.

The 'rule' that the scientist or the mathematician follows is an epiphenomenon. To take that epiphenomenon and use it to *direct* a process of reasoning is to misrepresent the manner in which the process of reasoning happened in the first place.

Think about adding two plus two. You got four, right? Did you follow a rule? Or did you just 'know'? Was it an experience more like following a map? Or more like recognizing your mother's house?

I've tried to writ about this at length elsewhere, but I'll just say for now, any account that depends on 'a student learning a rule' or the sort given in this post is missing the point of my own approach to learning (missing Wittgenstein's, too, but I digress).

Anyhow, like I said, a worthwhile discussion. I hope my comments have added to an understanding of how I think a network theory of learning differs from more traditional theories.

December 13, 2007

Downes on Kirschner

Over at his Half and Hour blog, Stephen Downes has posted a speech he gave recently criticising Kirschner, Sweller, and Clark’s paper entitled, Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry based teaching.

Downes begins the speech by telling us that he believes in connectionism. He describes what it is and describes how one teaches in a connectionist manner. Oddly enough, I agreed with much of what Downes was saying and thought that much of it was complementary to the theories set forth in Kirschner, rather than opposed to Kirschner as Downes seems to think.

Basically, Downes believes that knowledge and learning can be explained by using network principles, specifically by understanding how connections are formed in the brain network. Knowledge means having a certain organization of neural connectivity such that you can recognize certain patterns in the environment.

This seems to be neither controversial or in apposition to Kirschner. Knowing something means being able to quickly recognize and retrieve it from your long term memory in response to some stimulus. And pattern recognition seems to play same role here.

Then Downes states that learning is not having things pushed into your head but growing and developing in a certain way such that you recognize certain patterns. If by this Downes means that teachers cannot induce learning, I would disagree. The literature is replete with experiments showing that learning can be accelerated by the use of good teaching. See for example, the famous chicken sexing experiment in which the patterns of recognizing the sex of newborn chickens was greatly accelerated by use of summary sheet prepared by an expert chicken sexer. In this case, knowledge was certainly pushed into the student's head quicker than having the student sit in an authentic environment at the foot of the expert learning by observation.

Perhaps, Downes mispoke or I am interpreting what he said incorrectly. I just don't think this statement follows from what he stated previously or what he states afterwards.

In any event, Downes next defines learning and teaching. According to Downes, to teach is to model and to demonstrate, to present experiences so people can form these connections in their mind. To learn is to form these connections by practice and repetition and by reflecting on that practice. I agree with this, even though I disagree with Downes next statement that learning is best done by participating in an authentic community of practice. It does not follow from Downes' definition of learning that an "authentic community of practice" is needed to form the desired neural connections. I might be able to learn physics the long and hard way by conducting thousands of experiments like the great discoverers did, but it's much quicker and easier to learn the same things by reading a physics textbook prepared by an expert in physics.

All of this occurs in the first seven minutes or so. Downes spends the remaining forty minutes of his speech criticizing the Kirschner paper. Downes seems to think that the connectionist theory conflicts with Kirschner and instructivist learning. And seems to favor constructionism, problem based learning, discovery learning, and the like.

In my opinion, much of this time is spent parsing Kirschner's language, erecting a few strawmen (which he curiously doesn't knoock down), and manufacturing a conflict with Kirschner when in fact his theory is complementary with Kirschner's. For example, Downes characterizes Kirschner's position as being that non-instructivist teaching results in no learning. This is a strawman. The standard position is that non-instructivist teaching often results in less efficient learning, the probability is increased that incorrect learning occurs, and it favors those with more background knowledge. These are the standard criticisms and Downes does nothing to refute them, choosing instead to attack a strawman.

Let's examine some of these issues using Downes' definition of teaching and learning.

Downes defines teaching and learning as modeling/demonstrating coupled with doing/practice so that proper connections can form in the student's brain. Downes leaves out the feedback loop, testing, which is needed so that the teacher can make sure the student has actually learned correctly from the demonstration/model presented. Let's add it back in. The full blown schematic goes something like this: model, (lead), do, test, practice, delayed test. The lead step is optional and depends on the amount of guidance needed by the student. The delayed test is for determining if the learning has made it to long term memory. Oddly enough, this is the procedure they use for Direct Instruction, a pedagogy I'm sure Downes is four-square opposed to, yet which oddly enough is fully in accord with his definition of teaching and learning.

Looked at this way, learning comprises a presentation of a demonstration/model, the student attempts to replicate the model/demonstrate with or without a teacher's leading, the teacher tests to see if the student can successfully perform and has understood the presentation, the student then practices the demonstration, after a period of time the teacher again tests the student to see if the student can perform what was taught.

Learning is greatly dependent on the quality of the demonstration/model. The problem with most teacher presentations, as I pointed out here, is that they are usually fraught with ambiguities. Let's use the ambiguous glerm example. Some students will walk away from the demonstration thinking that glerm means rectangle or purple, instead of vertical, and may labor under that impression for quite some time. Using Downes connectionist theory we know that this student's brain is going to connect itself up so that the pattern for glerm is associated with purple or rectangle, all of which will have to be undone when the student finally learns that glerm means vertical. We also know that it takes many more repetitions to learn something that has been mistaught than it takes to learn something new.

Another problem is the misunderstanding of instructivist teaching as comprising mostly rote learning, learning devoid of understanding. Almost no one teaches anything by rote. The reason is that rote teaching is inefficient because rote learning doesn't generalize well. For example, one can teach addition by rote by asking the student to memorize all the addition facts, such as 1+ 1 = 2, 1+2 = 3, 1+3 = 4, ad infinitum. Using Downes' lingo, in order to learn these addition facts by rote, the student learns to recognize that the pattern 1+1 is 2 and that the pattern 1+ 2 is 3. This is inefficient because unless the student has been taught the pattern 1+3 he does not necessarily know that the pattern matches with 4. In contrast, it is more efficient to teach addition by teaching the general rule that to perform addition you need to start with the first number and count up by the second number. This is not rote learning and it is much more efficient. The student seeing the pattern 1+2 will connect it to the more general pattern number + number means perform the addition procedure. This is more efficient because the teacher does not have to teach every addition fact because the student has a basis for recognizing a pattern which leads to a generalized rule that works with all problems in the form number + number.

Constructivist pedagogy merely differs from the instructivist pedagogy in that the constructivists set up an environment in which it is hoped that the student discovers the general rule on his own with as little guidance by the teacher as needed. So, the teacher might show the student that 1+1 =2, 2+1=3, 3+1=4 in the hope that the student recognizes that adding one to a number means to count to the next higher number and eventually that adding any number to a number means starting from the first number and counting by the second number, which is the general rule. The theory is that the student, having discovered the rule for himself, will understand the rule better and be able to remember the rule better which means in Downes' terminology that he will be able to recognize the pattern better. There is some support in the literature for this effect. And, if all students always learned exactly what we wanted them the first time, this might be a more effective teaching technique.

But it's not. And the reason why it is not is because many students will not learn or discover the first time around as they try to discover the right pattern. What the students do is experiment by testing their known patterns to see if they fit. And, unfortunately, the students tend to learn these wrong solutions about as well as the right ones until the right solution acquires some dominance acquired through practice. And there's less time for practice what with all this discovery going on. Then there is the risk that the student hasn't learned the most efficient pattern, but one that happens to work with the environment at hand.

There is also the issue of the feedback loop, i.e., how does the teacher correct student errors when they fail to learn. This is also a pattern recognition problem; however, this time it is the teacher who needs to recognize the right pattern so the right remedy can be employed. This is difficult enough when the teacher has directly taught the rule to the student and there is some basis for knowing what the student has failed to grasp. But, imagine the difficulties for the teacher when the learning is occurring in a more information rich environment in which there are more variables to attend to.

I could go on, but this post is getting way too long. My point is that learning and teaching is a complex endeavor that isn't fully explained by Kirschner's or Downes' theories and that the theories are, my opinion, are more complementary than in conflict as Downes attempts to paint in his speech. For example, Downes ridicules Kirschner's brain model as being a flat store of data and procedures which gets searched sequentially. And offers, that the brain is more a neural network that searches for patterns, more of a relational database, if you will. More likely, the brain is more a network/schemata arranged according to patterns and containing lots of facts and procedures, and other knowledge that make up those patterns.

Lastly, even if we are to accep Downes' model, I still do not think that the model favors a constructivist/discovery learning paradigm as opposed to a instructivist paradigm. This confuses a theory of knowing for a theory of learning that I do not think is supported by the available evidence and ignores many real problems typically encounter in the learning process, some of which I've listed above.

Nonetheless, I think Downes's speech contributes to the discussion. I certainly learned something or at least it's lead to a better understanding. But, I'm not exactly an novice in this area.

December 11, 2007

Er, I think you're forgetting something

In this Providence Journal article, Julia Steiny goes to great pains to describe the historic flaws in our secondary schools. The problem is that she leaves out the most important part. See if you can spot it.


At the dawn of the 20th century, educators were faced with a huge influx of children from foreign-immigrant families and families coming to the cities from farmlands. Educators turned to America’s signature dynamo at the time, the factory, after which they modeled America’s comprehensive secondary schools.

Got it? I'll give you a hint. Educators didn't model schools after the factory, at least not directly.

Educators turned to the government to run the schools and then these government-run schools turned to the factory model. And, therein lies the rub.

Steiny goes on to set-up an extended metaphor that completely misses the mark due to this omission.

As it turned out, the problem wasn't with the new immigrants--they eventually performed as well as other Americans who came from Europe. The problem was that no one had ever figured out how to educate the unwashed masses-- the lower 75% of society. So when we turned the enterprise over to the government, the government had no successful model to emulate, so the "factories" they set-up were all defective. In a properly-operating free-market, the market would work behind the scenes to divert resources from the failed models to the more successful models. Deprived of resources, the underperforming schools would close down and the successful schools would be emulated. But with government in the act, the free market is pushed to the side. Resources are determined by politics. With no incentive to improve, schools don't try. No failing school gets closed. The result is, well, the system we have today. Today, schools are only capable of educating the same kinds of kids the were capable of educating back in the early 20th century. The unwashed masses don't get educated.

You can always spot an unreformed lefty by this large intellectual blindspot. This blindspot marred the otherwise well-written book by Sherman Dorn, Accountability Frankenstein. Dorn takes pains to describe the forces that affected and shaped the American education system but inexplicably fails to mention the one, most likely the largest and most influential factor. That's too bad, especially since Dorn tries so hard to be evenhanded.

December 10, 2007

The Not-So-Suprising Conclusion of Once Upon a Time in Kansas City

(Continued from Part One)

The wizard Clark waited for his creation to cook.

He waited.

And, he waited.

He waited for five long years--the amount of time his grand vizier told him it would take for the plan to work.

The grand vizier told the wizard to have patience.

So, the wizard waited some more. Patiently.

The wizard waited seven more years. And his patience began to wear thin.

The wizard had followed the grand vizier's plan to the letter. The wizard had spent more gold on the school district of Kansas City than any city had spent before. He had improved the buildings, provided lavish educational resources, bussed in magic aura kids and harnessed their power, provided full day kingergarten, provided day care and before and after school activities. He had increased teacher salaries by 40% across the board, reduced teaching loads, implemented Montessori-like elementary schools, and reduced class sizes to lower than they had ever been.

In short, he had done it all--everything the high priest of Kozol had recommended, nay, had assured him would work.

And, yet test scores remained were they had been for so many years--below state norms. Finally, the wizard order a full accounting from his advisor. The verdict: The wizard's plan hadn't "changed any of the measurable outcomes."

The wizard looked upon the grand vizier with disgust. The grand vizier smiled meekly and began to suggest something he called Universal PreSkool that he assured the wizard ....

A bolt of lightning shot from the wizard's wand and the high priest was reduced to a small pile of chalk dust.

The wizard was now enraged.

Twelve years, two billion dollars, and nothing to show for it. The wizard prepared to cast an even more powerful spell of taxation when nine even more powerful wizards from the court of Rehnquist appeared to put and end to the wizard's nonsense. The nine smote the wizard Clark who was forced to flee Kansas City and lifted the wizard's spell of taxation.

But the wizard fled, he took revenge on all the people of the Kingdom by placing a curse which made them forget the lessons of Kansas City and doomed them to repeat the mistakes over and over in perpetuity.

The wizard, however, saved his best curse for the high priest of Kozol--the NCLB curse--which eventually drove the high priest mad, whereupon the priest lived his remaining days in a state of of partial fast subsisting entirely on a diet of vanilla lattes.

There was no happy ending. For anyone.

Tomorrow the moral of thes tory.

Winerip Gets Snookered by Smallest School Study

The NY Times needs to hold a seminar on introductory statistics for its reporters, especially its education reporters, so they stop turning in articles like this one one by Michael Winerip which seriously confuses correlation with causation.

It is ETS that deserves the real blame, however, for taking advantage of the statistically gullible, i.e., Winerip. The reason they deserve the blame is because they were peddling their statistical survey "study" as implying causation: From the report Highlights, paragraph one:


The family and the home are both critical education institutions where children begin learning long before they start school, and where they spend much of their time after they start school. So it stands to reason that improving a child’s home environment to make it more conducive to learning is critical if we are to improve the educational achievement of the nation’s students and close the achievement gaps. To do this, we need to develop cooperative partnerships in which families are allies in the efforts of teachers and schools. The kinds of family and home conditions that research has found to make a difference in children’s cognitive development and school achievement include those
highlighted below. (emphasis mine)

The highlighted sentence is the one that lets Winerip plead incompetence, when he gets accused of having a political agenda. Here's what happened.

ETS collects a lot of student data. Once in a while they sift through the data to find the typical unsurprising correlations.


  • students from single parent families on average tend to underperform academically.

  • students from poor (resource deprived) families on average tend to underperform academically.

  • students from language-deprived families on average tend to underperform academically.
To name but a few.

The problem is that ETS is trying to ascribe causation to these various correlations without going through the effort of proving causation. The problem is compounded when ETS peddles their causation theories as fact in, say, a Highlights report designed for statistically-illiterate journalists, i.e., Winerip.

For example, the fact that students from single parent families underperform academically could mean at least three things.

1. the single parent family environment causes lower student achievement;
2. lower student achievement causes more single parent families;

3. some third variable causes both more single parent families and lower student achievement. (One plausible variable is low IQ.)

ETS is suggesting that it knows that the right causation is number one. And, goes on to suggest that improving the familial conditions it has highlighted will lead to increased student performance. (Winerip merely parroted ETS's suggestions and added a shriller tone.)


These are the things bad governmental policy is made of. It all starts with shoddy "research."


Here's a picture of one of the co-authors of the ETS study who's hoping his countenance of fatherly concern will convince you to swallow his dubious "research." Think of the children.

December 7, 2007

Once Upon a Time in Kansas City

The second most important experiment in k-12 education took place in Kansas City during the years 1985 and 1997. Most education pundits have apparently never heard of what went on in Kansas City, for if they did, embarrassment and shame would prevent them from continuing to recommend the education policies they so frequently suggest.

My understanding is that humans learn best from stories, so I've cast the travails of Kansas City into a story. So gather 'round kiddies and prepare to be amazed at the wondrous tales I will tell. I've reserved the front row for the edubloggers. It's a long and winding story with many whiles and wends...

Once upon a time ...

... there was a great and prosperous kingdom known as America. Nearly all the subjects were wealthier than the people of the surrounding kingdoms, yet things were not perfect. One day a mighty dragon, known as LBJ, flew into the kingdom and decided to make the kingdom of America into a greater society, if you will. LBJ was a well-meaning dragon who toiled tirelessly to transform the great cities of the kingdom into paradises; however, unbeknownst to the dragon, he had been cursed by Merton, the god of Unintended Consequences, such that all the good the dragon did would turn out bad. And, so it did.

The dragon flew from city to city casting powerful magical spells which terrified the city folk of America and wreaked havoc on the cities. As a result, those that could flee the cities, fled the cities to hide from the spells cast by cursed dragon which were bringing terrible storms to all the great cities. Only those that could not afford to move from the cities stayed in the ruined and once great cities. When the great dragon LBJ saw the consequences he had wrought, he promptly flew to the closest volcano and cast himself into its bowels, never to be seen again.

Tthe great cities of America never recovered from the unintended wrath of the dragon. All the great cities were now impoverished and destitute. All the capable citizens had fled the cities, leaving only the incapable to fend for themselves. The incapable, being incapable, once again proved their incapability by failing to provide for themselves. The great cities of the kingdom reverted to poverty like almost all the cities that comprise the lands outside of the kingdom. Much gnashing of teeth and wringing of hands ensued trying to rectify the conditions in the now impoverished cities--especially when it was learned that most of the people who remained in the cities were disproportionately the black and brown people who lived in the kingdom. The debate rages as to why this is so. No one knows for sure, but no one seems to be satisfied with the outcome.

One day a mighty elf-wizard named Clark visited the Kingdom. The wizard had been appointed by the once mighty king Carter, whose reign was thankfully brief. The wizard Clark was a very special wizard who did not abide by the wizard handbook that bound the wizards and prevented them from engaging in the black arts and doing much mischief. The wizard Clark, however, thought the Wizard handbook was merely a guideline, and not rules, per se, which he needed to follow so long as he was trying to do good. Clark was a very foolish wizard, but a very powerful wizard, as you will soon learn.

Upon seeing the turmoil that plagued the kingdom, the wizard Clark tossed out his wizard handbook and teleported to the closest city-the once great city of Kansas City to do some good.

Upon reaching the city, Clark sought the advice of a well-respected vizier who thought himself very wise. Unbenownst to the wizard Clark, the vizier was a charlatan who practiced the dark arts of Edukashun-- a discredited school of magic that was shunned by the other schools of magic because they failed to abide by the rules of magical inquiry. Its practitioners spouted all manner of nonsense in reckless disregard for the truth and never thought it necessary to substantiate their magical opinions. This was a very unfortunate development for the thick-skulled wizard Clark who had sought the counsel of the grand vizier, thinking him to be very wise.

The grand vizier was a very confident and convincing vizier in all matters of Edukashun. The vizier promised the gullible wizard Clark that by using the powers of Edukashun he would be able to restore the vitality of the once great Kansas City to its former splendor in five short years. The wizard Clark inquired as to the parameters of the Grand Vizier's plan. The canny vizier told the wizard that he could not provide specifics until he made a pilgrimage to the high holy land of Kozol in a distant kingdom, but that he was quite certain that the plan would require much gold to implement properly and that the wizard should start collecting as much gold as possible with all due haste. The wizard Clark bade the grand vizier farewell and set out on his quest to obtain the precious gold.

The wizard Clark may have been a mutton head, but he was still a very powerful wizard. He surveyed the lands surrounding the city of Kansas City and saw that the lands were full of hard-working, capable people and great wealth. He immediately realized he had found his pigeon and cast a mighty spell of taxation on the surrounding lands. The incantation enslaved these rich and greedy people and forced them to pay yearly tribute to the wizard. For the next twelve years the wizard Clark ruled like an emperor of yore over the people and managed to extract 2 billion dollars in gold from them and sent it to Kansas City to enact the Grand Vizier's plan.

The gold began flowing into the Kansas City coffers in the year 1985, the year the grand vizier returned from his pilgrimage to Kozol. The wizard, pleased with his spell of taxation and the riches that were flowing into the imperial coffers, summoned the grand vizier to outline his plan of Edukashun.

The grand vizier unraveled the large scroll full of the ideas he had obtained from the high priests of Kozol. Being a vain man, as so many of the practitioners of Edukashun are, the grand vizier selected a few of the most fashionable and faddish ideas from the scroll, read them to the wizard, and assured the wizard that these ideas would work miracles in short order. The wizard laughed a mighty laugh and showed the grand vizier the mountain of gold that lay in the wizard's treasure room. The wizard then informed the grand vizier that they had sufficient gold to implement all of the ideas on the scroll, and should proceed to due so with all due haste in order to restore the city of Kansas City to its former glory. And, that is exactly what happened.

In short order the school district of Kansas City was transformed into the most lavish school district in all the Kingdom. 15 new state-of-the-art schools were built and 54 existing schools were renovated in Kansas City. The schools contained such amenities an Olympic-sized swimming pool with an underwater viewing room; a robotics lab; professional quality recording, television, and animation studios; theaters; a planetarium; an arboretum, a zoo, and a 25-acre wildlife sanctuary; a two-floor library, art gallery, and film studio; a mock court with a judge's chamber and jury deliberation room; and a model United Nations with simultaneous translation capability. The Kansas City School District was spending nearly $12,000 per pupil, more than any other school district in any of the great cities of the Kingdom.

According to the grand vizier's plan, these new facilities would magically make it possible for the students to learn, which they were prevented from doing in their old decrepit schools. Once the school facilities were fixed, the grand vizier began the most ingenious part of the plan. A million dollar advertising campaign was started to attract students from the surrounding lands. These were good students who had learned much using the primitive techniques that failed with the children of Kansas City. The priests of Kozol believed that these children possessed magical auras that would charm the less-able students sitting next to them, so the idea was to lure these magic children to Kansas City through the fancy new schools so that the magic of their auras could be harnessed to further the grand vizier's plan.

The magic aura students were offered a free bus ride to and from Kansas City every single day to attend the schools and lend the children of Kansas City the power of their auras. If the child didn't live on a bus route, the King's personal taxi would be sent to transport these wondrous children. Once the magic aura students got to Kansas City, they could take courses in garment design, ceramics, and Suzuki violin. The computer lodestone school at Central High had 900 interconnected computers, one for every student in the school. In the performing arts school, students studied ballet, drama, and theater production. They absorbed their physics from Russian-born teachers, and elementary grade students learned French from native speakers recruited from Quebec, Belgium, and Cameroon. For students in the classical Greek athletic program, there were weight rooms, racquetball courts, and a six-lane indoor running track better than those found in many colleges. The high school fencing team, coached by the former Soviet Olympic fencing coach, took field trips to Senegal and Mexico. It was truly a magical time in Kansas City.

But the grand vizier's plan took no chances, for some of the high priests of Kozol thought that more was needed than the auras of the magic aura students to help the less-able students of Kansas City. So, the ratio of students to instructional staff was lowered at great expense to about 12 to 1, the lowest of any major school district in the Kingdom.

The queen's royal necklace, worth $25,000, was exchanged for a pile of beads, blocks, cubes, weights, balls, flags, and other manipulatives to stock all the new Montessori-style elementary school classrooms in the district. In these classrooms, younger children took midday naps listening to everything from chamber music to "Songs of the Humpback Whale."

A bag of magic beans was also acquired so that all the working parents the district could be provided with all-day kindergarten for youngsters and before- and after-school programs for older students. No expense was spared.

In fact, so much gold was consumed in Kansas City that the school district was overwhelmed. Mismanagement and waste were rampant, but there was so much gold in the treasury due to the wizard's taxation spell that the grand vizier got everything he wanted. Yet, he was still not satisfied.

The surrounding lands were placed in much turmoil due to the heavy taxation they were forced to endure. The wizard was much despised, but he was far too powerful to be overthrown. The taxation persisted and the people of the surrounding lands were forced to tighten their belts, forcing the cancellation of field trips and extracurricular activities, the deferral of maintenance, the firing of teachers, and freezing of salaries. The decline in state revenue cost the neighboring Springfield school district $4 million, the hometown of the wizard Clark,--4 percent of its entire budget. As there was no slack in the budget, Springfield had to fire 19 employees; defer grouting the mortar on 100-year-old brick buildings; cancel public speaking classes; dispense with water safety courses; and beg for money to send students to the Civil War battlefield at Wilson's Creek, an annual trip that had been made for decades. The wizard Clark was not dissuaded from his plan with these tales of woe and instructed the grand vizier to continue on.

The high priest of Kozol had long believed that class sizes had to be reduced for performance to improve. To that end, the official class size in Kansas City was reduced to 22 per room in kindergarten and 25 in high school, though so many students cut classes in high school that the effective class size was often closer to 15. The high priest also believed that teachers needed their workload reduced. In some schools like Central High, teachers taught only three classes per day. Finally, the wizard raised increased teacher pay a total of 40 percent to an average of about $37,000 (maximum was $49,008 per year for Ph.D.s with 20 years experience). To put this in perspective, at the time, parochial school teachers were earning an average of $24,423.

All of the grand vizier's plans had been faithfully implemented. The wizard ruled over the transformed school district, running interference for anyone who would try to prevent his plan from being brought fruition. The high priests of Kozol smiled upon their creation with the smug countenance that only they can achieve. They predicted a very happy ending for Kansas City. All that was needed was enough time for the creation to finish cooking. It cooked for twelve long years. The wizard remained steadfast the entire time.

But you'll have to wait until Monday to read the conclusion to the story. Think you can guess the ending?

(Go to the Conclusion.)

December 6, 2007

Teaching Needy Kids in Our Backward System

Last January Zig Engelmann made available on his website his unpublished book--The Outrage of Project Follow Through, Five Million Failed Kids Later. If you missed it back then, you are in luck, because the book has now been published by ADI as Teaching Needy Kids in Our Backward System. It is available at Amazon, but if you order directly from ADI you can get an autographed copy and a $7 discount if you don't factor in Amazon's free shipping. Zig has made the forward and table of contents available (pdf).

It is an important book.

It looks just like the plethora of other education books out there. But it is different. Unlike other education books, it was written by someone who has actually successfully educated many schools full of low performing students. This is something the likes of Jonathan Kozol, Alfie Kohn, Gerald Bracey, et al. have never done. That's why no one has ever been able to take the wisdom of Kozol, Kohn, or Bracey and improve the academic performance of a school full of low performing children. In contrast, Zig's theories have been used many time over the last 42 years to transform failed schools into successful schools. And yet, as Zig points out in the forward:

We showed what could be done, but our work failed to convince even one major school district to do it, even though it would be far less expensive than what they are doing now.


That is the big question. Why hasn't even one of the schools than Zig turned around stayed with Zig's program as soon as the next administrator rolled into town? It's as though someone handed a failed school district a big pot of gold and told them to fix their woes by lowering class size, paying teachers better, and instituting all the things the Kozol gang thinks failed schools need. Imagine if we gave a school district unlimited funding and then the school district screwed it up.

If you think that no school district could ever be that incompetent, then you've never heard about what happened in Kansas City.

I'm going to post about the travails of Kansas City in the near future because it represents, in my opinion, one of the most important lessons in education. In the meantime, go read Zig's book. Then read the whole story about Kansas City. The you will have a much better understanding why k-12 education is so screwed up and why the typical bromids don't work and why the effective remedies have little chance of being implemented in most school districts and are likely to be implemented incorrectly in those that try.

December 5, 2007

I'm Back

Sorry for the lack of posting, kids. Real life sometimes interferes with hobbies. I've been busy with my real job, the holidays, and most recently a trip to Disney World, leaving little time for blogging. But, I have been keeping up somewhat with the goings on in the edusphere, so I'm ready to jump back in with some new posts. As soon as I write them, that is.