Farewell to Mangochi

We returned to the office and synchronized our data for review. The only problem noted was one set of PDA records seemed to have happened the night before. I chuckled when I realized that it was my mistake. I had forgotten to change the PDA's clock to the correct time zone after leaving Armenia last week. The PDA catches everything - including the consultants' mistakes!

That afternoon, I gave my final presentation to senior staff. I recommended that they procure several PDA's and use them in a pilot program in a parallel effort with a paper-based survey. I also risked an internal organizational suggestion. When I was picked up at the Nkpola Lodge on my first morning of instruction, my driver was actually Lloyd, the manager of Logistics and all of the drivers. Later that day when I asked to see where the servers are located, I was somewhat alarmed to see Lloyd sitting at the keyboard of one of the servers. I found that Lloyd was also the IT support for the Mangochi office. During our many drives together, I found Lloyd not only quite friendly but well skilled for IT work. I spoke with him and asked what would he really like to do - manage drivers or do IT work (he actually used to be an IT instructor in networks at a local school)? He replied IT. Kwandani, the Field Office Regional Technician (FORT) told me that Lloyd was doing a great job. So, during my exit presentation, I added a single bullet that the Mangochi IT support be a dedicated position. All were happy.

Field Testing at the Kausi and Nasite Schools - Mangochi

After the form was deemed designed, I taught the team how to load (also known as "synchronize") the form onto each of the PDA's that we would use for testing. Then, I had each PDA holder to conduct several interviews with other team members. We then synchronized the collected data back to the form designer and it looked all good. We were ready.

We took two vehicles and split the team in two and each group headed to a different school. The group that I went with arrived at the Nasite elementary school but a few kilometers south of Mangochi. I love this part. We first presented ourselves to the head teacher and it was explained why we were there, and what the purpose of our trip was.



While the team split up to interview teachers in their classes, I took a moment to enter a large classroom next door. A young teacher was seated at a table in the far corner of this room with a dirt floor interspersed with broken concrete and no lighting. He had several students at his desk as he was writing in a register. I asked him how many students that he had in his classroom each day, and he said that it averaged about 198.



As I walked out side his classroom preparing to follow and observe a PDA team member, I noted a group of children under a large tree trying to avoid the rain. The next series of pictures were taken within an interval of perhaps 5 seconds between them and within a total of less than 30 seconds:



2nd



3rd



The interviews went smoothly and we soon departed to meet up with the 2nd team at the Kausi school nearby. I will never forget riding up to the school site in the back seat and Amy Richmond in the front. Both of us are quite light-skinned. The chanting that we heard as we drove up across the compound was from the children racing across the yard saying, "The Whites are here, the whites are here!" As we were introduced to the head teacher (in a stunning bright blue suit), I noted several older students using small wispy branches to literally whisk the students back to their classrooms. I thought to myself, I wish I could of had that job back at my small elementary school in the 1960's suburbs of Southern California.

I was observing one of the team members interviewing a teacher with his PDA just outside the classroom. I emphasize the need to observe a respondents visual cues in order ot assess their willingness to be interviewed with technology, and to be alert on when there is a need to employ ones' developed set of interviewer skills to enjoin trust in order to have a successful, unbiased interview (if that is possible).



In the first picture above, the respondent is displaying body language of hesitation towards the interviewer and the PDA. Note the hands on the hips, and the leaning away from the interviewer.



In the second picture the interviewer has wisely turned the PDA screen towards the teacher, who has now begun to lean towards the interviewer and has begun demonstrating curiosity towards the interview collection instrument. Hold on, we're not there yet!



Now, the interviewer has gained the respondents trust and curiosity has been disregarded for the moment. note how the body language of the teacher has changed and now the PDA is disregarded and the teacher is instead thoughtfully considering his answers to the interviewers questions.

Please note, that with a PDA, an interviewer is not able to hold up the classic large clipboard and paper survey form which can often act as a barrier, both physically and communicatively between the two persons. A PDA is different and actually can be leveraged to enjoin trust.

What Will be the Results of My Questions?

The Results Framework

A note about the Results Framework. It is just that, a "programme logic that explains how the development objective is to be achieved, including causal relationships and underlying assumptions...” Wow! Let me give a simple and possibly error-prone example. Let's say you have suddenly had some unexpected even in your life that caused to perform some introspective review of your life's' goals. Let's say further that you lost your job and did not know how you would pay the bills and buy food. You might first think that you need to quickly get another job. But, you realize this might be an opportunity to review your life in general. You do just that, move it up a few levels and generalize. What do you want in life? Your responses might be, "I want to be happy!" Well, take it down a level. "I want to have money to buy necessities and enjoy good health."

Go further. "What will I do to enjoy good health (eat right, exercise, maintain healthy social relationships, etc.). Well, an important part might be, "how will I know that I have achieved these goals?" Well, you might define a list of measurements such as ideal weight attainment, percentage of healthy food groups in each weekly meal, defined progressive weight changes, blood pressure, cholesterol, etc. measurements over the year. As you disciplined yourself to measure these criteria of having good health, which in turn would be an element towards achieving "happiness", you would have an idea if your program of self-improvement was working...or not working. If your program was not working to the desired goals, you would either review or modify those goals (I really cannot drink another drop of organic carrot juice!), or change them altogether ("weight loss is not really producing the desired effects!).

My illustration is the questions that you would continually ask yourself would be based on your original objectives and the criteria that you defined to ensure that you were headed in the right direction to achieve that "state of happiness". The vital issue is not how healthy am I, but am I "happy".

The Results Framework is a method of defining a program's objectives, defining a strategy to achieve that objective and then to describe intermediate results that will yield indicators to tell you if you are indeed achieving the "state of happiness" for the programs beneficiaries. Likewise, in relation to survey questionnaires, it is not the question itself that is important, but what indicator was defined by the Results Framework that is described by the question so that I might monitor and evaluate whether I am achieving my strategic objectives for the programs success for the community.

So, how would the Results Framework help me build better survey forms? A clear definition of what I am trying to achieve towards a desired state, will then guide me toward what are my objective to achieve that state, and what questions shall I ask myself periodically to determine if I have reached that state. If, after I produce my set of question, I see that some of questions seem relevant, but would not directly contribute to my knowledge of my stated goal.

The following shows an example. The Intermediate Results Strategies at the bottom would then be used to develop the questions to be asked to see if you are achieving your objectives



Again, this is a framework designed to enable you to map out and clearly illustrate what you want to do. Like my college English professor told me, "you really do not know what you are thinking until you begin writing it down"

What Am I Trying to Say?

Structure – Logic – Question Flow

As I have mentioned before, I have repeatedly found the technical aspects of PDA data collection do not seem to be daunting. What I mean is that the technical aspects of the PDA hardware and the forms development software do not seem to be difficult nor limiting factors in producing a viable form design. What the teams often struggle with are in the deciphering of the structure and logic of the existing paper survey forms. The development of a PDA software form just seems to enhance any inherent problems with the existing paper forms. What I like about mobile data bases (a PDA form), is that they demand a clear logic. This can be difficult to wrestle with - clearly understanding one's form before you actually build it. But, how many of us begin pouring concrete for the foundation of a house without first thinking, discussing and producing a design to meet the requirements?


An object if inquiry (in this case a paper or PDA form) might involve 3 elements:

Structure - Logic - Question Flow

By structure, I mean how the form is literally laid out on paper - the ink, so to speak. Not only does a paper survey form (or any image of communication) have the questions typed on the paper, but there are other non-textual cues in the form design functioning as aids and guides to the form. For example, there are non-question texts such as the title of the form, instructions for using the form ("ask the question, but do not provide any answers to the respondent for the possible choices to be recorded"). Also, formatting is used to denote hierarchical levels within the form (BOLD, 16 pt. font for the major survey section, BOLD 14 pt. font for sub sections, etc.), in addition to lines of varying thicknesses, colors and a multitude of other visual cues for the form user. These form structure elements need to be understood for their intent and duplicated on a far smaller PDA display.

The logic of the form is just that. It is similar to what computer programmers employ to replicate the logic of real world thinking. For example on a paper form a question might read, "Is the woman pregnant?" If the answer is yes, move to questions 14 through 22 on pre-natal health. If the woman answers No, then continue skip questions 14 through 22 and move directly to question 23 on household income. logic is actually contained within each and every question. Each question has an "entry" rule(s) in order to govern whether the question should be asked, and each question, once it has met the entry rule(s) has an in internal set of rules that will determine validation of what can be entered as a response.
For example, we will not accept the recording of the weight of a baby of the age range of two to five years of age, of less than zero kilograms, nor greater than 100 kilograms. I am freely using hyperbole here to demonstrate my point. Once we achieve interplanetary NGO efforts, we might need to re-write the logic of our survey forms. Lastly, each question has an "exit" rule that, depending on the other rules, determines what action to take or to which question is to be shown next. Of course, the majority of questions have very simple logic and simply progress in a lineal fashion; just record Yes or No for questions 1 through 108.

The question flow is strongly related to the question logic, but it more describes the overall intent of the questionnaire. It is something like the "stand back and look and what you are trying to achieve with the entire set of questions. Sometimes one can get too involved in the logic, rules, and details of each question and forget the objective of the form. For example, "Why are we taking the time and effort to ask this mother 108 questions? I recall that we only had 4 intermediate results defined in our Results Framework which resulted in 18 variables required for program analysis?" Are why designing a coherent form that leads both the interviewer and respondent in an understandable conversation that reaches beyond a survey instrument and incorporates a human-to-human discussion relevant to the program deliverables that will improve their lives. This is actually the most important part.
So, what is this Results Framework (alternatively termed the Logic Framework), and what value can it provide in designing a survey form, whether used on paper or a PDA? The fact is, the Results Framework determines what the question will be, while ensuring that the question asked (and the response content) will provide information to determine if a program efforts are indeed producing the desired result.

The Head Teacher Interview Form

Here is how the form looked on the PDA's after we agreed on the forms' intent. The first screen identifies to the interviewer the title of the form and its purpose. Note the Save the Children branding.



The next screen, shown below, regards data privacy and reminds the interviewer to ask for the respondents permission to be interviewed.



If the respondent declines and the interviewer records "No", then the form simply moves to the end of the form and instructs the interviewer to thank the respondent for their consideration.



If the responent agrees to the interview, the first screen of questions is presented to the interviewer.



For instance, instead of having to type in the interviewers own name, they simply "tap" with the PDA's stylus (onscreen equivalent to a PC's left mouse click) on the button entitled "Lookup..." to the right of "Interviewer Name" and they are presented with a list of interviewers..



The PDA form designer can either limit the interviewer to only a selection of pre-determined interviewer names from the Lookup list, or they can allow them to type in an additional name not listed. This is a design consideration, and often you will want to restrict the selection to an exclusive list of items presented (in this case, interviewers names). But, you always need to consider what unexpected conditions that might be encountered in the field and to allow flexibility for the PDA user to add to the list on-the-fly, so to speak.myself.

There are also the flexibility in form design to offer a list of multiple selections of responses to a question ("AND" responses)



Now, let's see how the logic of the "what is your highest level of academic achievement" question displayed.



When the interviewer taps the Lookup button, they are presented with the four choices, including "Other" (notice "please specify" does not need to be shown)



If the respondent provides one of the first three responses, it is simply recorded and then moves to the next question. however if they choose "Other", then they are instead directed to a screen and asked to type in the "Other" achievement.



There is no way out of this sequence of screens - the logic must be followed, unless the interviewer makes the incorrect selection. Even then, the PDA form designer has a multitude of ways to guide, or even force, the interviewer to make the correct choices. Few of this PDA form functions are available for a paper-and-clipboard method of surveys. You can write anything on a paper form...

Save the Children - Mangochi, Malawi

This one of the largest teams that I have had for my training sessions. It is well represented from a broad cross section of the disciplines here at the Mangochi district office of Save the Children USA here in Malawi. Not only are the M&E and IT representatives here, but interested representatives from the various field programs. What a delight!



Our focus for field testing the PDA's is going the Education group, and specifically a Head Teacher PDA survey form that we will test at a couple of schools. The training was conducted in a very large conference room well suited for meetings and presentations. But, I quickly realized I would need to help the participants by dissolving the wide circle of tables in order to bring the participants in closer. This was needful not only to bring them closer together physically in order to hear me speak (I do not lack, I have heard, the ability to project my voice) and to see the training materials, but more importantly to develop the sense of a team. So, I rearranged the room (to the obvious delight to some, and dismay to others desiring to remain on the fringe) to this:




The team quickly picked up on using the PDA's, and after I quickly designed a simple form, I asked for a decision on a form that we would design and take for field testing to the program location. They selected the Head Teacher Interview form, but decided to use it not only for the head teachers (principles), but also the rank and file teachers as well.

What follows is the first few questions of this candidate form. I will focus on the 2nd question of the form: "What is your highest academic qualification?"

Save the Children
Sponsorship Primary Education Program

2007 Standard 4 Data Collection

Headteacher Interview

School:___________________________ Name of Interviewer: _____________________________

Head’s Name: ________________ __________Sex: 0__Male /1 __Female: School Code: 19/__ __

1. Standard(s) teaching _____________
2. What is your highest academic qualification?
A) JCE/ B) MSCE/ C) "A” levels/ D) Other (Specify): ___

The first few questions of this form was simple enough, only requiring brief discussion on the response codes for gender and the source of school identification codes. However, question 2 asking "What is your highest level of academic achievement?" In order to overcome my deficiency on cultural and language, I try to watch for audible and visual cues provided by the group. After asking the group what this question meant, I noticed that several dissenting sub groups emerged. I gave time for their inter- and intra- sub group discussion to occur. I not only wanted them to arrive at a consensus, but I also wanted to observe their decision dynamics, for this team in particular, and possibly cultural, as a whole progressed.

Here was the issue. Question two had, what appeared to be, four different responses to the question, "what is your highest level of academic achievement?" The response could be JCE (2A) OR MSCE (2B) OR "A” levels (2C). There was a 4th response called "Other", which I termed (2D) for discussion purposes. This last response also indicate (but I was not sure), please specify the name of the "other" academic achievement. Actually I annotate all question and survey artifacts with shortened notations. I actually utilize these notations for scripting (a simple form of programming) used by the forms design software to define and operate the logic of the form.

Since a teacher could achieve several levels of academic achievement (e.g. our Bachelors, and then later Masters, or Doctorate degrees), the question was asking for the "highest". So, the response logic was of the "OR" type. You could only respond to one, not two or more. This Other was causing the debate. Was other in addition to a response of 2A, or 2B or 2C, or was it a distinct "highest" achievement of it's own, simply unnamed in the 3 responses?

The debate went on for 1 1/2 hours. I allowed it to proceed since I did not want to influence the decision. But I was also wanting to use this issue and a cause for describing how that paper forms often hide their logic. In addition, I wanted to also point out that the issue is not with the logic of the specific question, but rather goes back to the design of the survey based on the Results Framework. At one point, rather meanly, I even asked the question of how long this questionnaire had been being used? It is amazing how paper forms can perpetuate an illogical or misunderstood indicator.

The team decided that the "Other" was just another unlisted highest academic achievement that should be captured but was not listed in the other three responses. So, 2D was an "OR" response. There was actually a lot of discussion that "Other" actually meant an "AND" response with the intent to capture any additional academic achievement.

This discussion of the minutia of a single question is certainly tedious. But, it is just one example that I began to encounter while endeavoring to have a team build a form in order to field test for value determination of PDA's to replace paper survey methods. In the very beginning I tended to overlook this close examination of the actual meaning of each of the survey questions. But, as I did, I found that our post field test reviews of the data collected tended towards lively debates of what the data meant. I then realized that the issue was neither with the data nor the PDA form, but a lack of consensus of the meaning of the question, or more accurately, what was the presumption of what the answer would provide. I saw that if there was not a clear understanding of the structure, logic and question flow, then I not only could not train a team to produce a usable PDA form, but worse yet, I would possibly perpetuate an instrument of mis-information that might directly affect peoples lives.

Nkopola Lodge - Mangochi, Malawi

We stopped by briefly at the Save the Children office here in Mangochi. After a few introductions, notably with my PDA Team Leader Francis Mabeti, Lloyd Msiska, the Information Technology (IT) manager, and Amy Richmond, the Sponsorship Program Manager.

Francis is the Monitoring and Evaluation (M&E) manager (I will describe what M&E is about later) and he and I will work together closely. Lloyd not only keeps the computer systems operational, but he also manages the transportation logistics. Amy is who I would describe as being responsible for the Mangochi Sub-Office.

Since we had been traveling for most all day, I was then taken to my lodgings during my work here. Now, I never know what kind of place I will be staying, which makes it interesting. It can be simply a guest house, hotel, or with a staff member at their private residence (my preference). I usually do not ask questions about my accommodations, but I just leave it up to the CO. They know best how to provide secure accommodations in the context of the area. All of my expenses while in country are paid for by the Westport It group of Save the Children, but the biggest issue for me is not to cause unnecessary effort or indirect expense to the CO. By this, I mean, I try to stay close to the office in order to minimize the logistics of picking me up each morning.

So, I began to be a bit disappointed in after an hour travel north we still had not reached my lodging. Later, it was explained that, as in Liliongwe, there was a huge gap between types of lodging in Mangochi. We soon turned off of the paved road onto a dirt road and arrive at the Nkopola Lodge after but a mile.



Well, was I wrong. It was beautiful. The Lodge is located right on the southwest shores of Lake Mangochi. The staff courteously greeted me and I was taken to my small room, somewhat of a small cottage with the back facing the white sandy beach of the lake. I unpacked and plugged in all of my PDA's to make sure that they had a full charge for tomorrows training session.



The next morning dawned on a stunning sight out my back sliding glass door. This was one of the beautiful places that I had been to. I called up room service and asked for my breakfast to be delivered to my room. When the young man arrived with my breakfast, I asked that he walk through and place it on the table outside so I could view the lake while dining. As I sat down, I saw that it was so beautiful that I turned to go inside and grab my PDA to take a picture. Within the few seconds time span, two monkeys took position on a low wall separating me from the adjacent room not more than four feet away. I had no idea that there were monkeys here, and they just showed up out of nowhere!



Well, these two uninvited simian breakfast guests were inching towards my breakfast even as I drew back to the table with PDA camera in hand. They removed themselves back along the wall to watch me dine. The moment that I finished and walked inside closing the glass doors, they, and two others pounced on the table and lifted the plates to lick off the contents - all without knocking over a glass or disturbing a utensil.

On the next few mornings, I began to notice that the monkeys would scurry across the cottage roof tops in parallel to the movements of the room service delivery persons. In this way, I knew when my meal was about to be delivered - when they paused on my roof. Sure enough, a knock at the door and everyone was ready to eat!

Astride the Malawi and Tanzania Border

I am about to leave for Mangochi to start the three days of training and field activities. There will be two days of training for the hardware and software and then a third day of field testing of the forms that the team designs. This will be a bit of a compressed schedule, but I have learned how to be flexible under field conditions.


I enjoyed my drive from Lilongwe to Mangochi yesterday. This very fine highway extends southeast out of Lilongwe and follows a elevated spine directly east of Tanzania. It rains intermittently here a great deal during this season. The weather is delightfully warm (thawing out from Armenia still!), but fortunately it is not hot, but it is lush and green. The views to the plains below were some of the most spectacular that I have ever seen.



At one point when I discovered that Malawi was on our left and another country which I had not visited was on our right, I asked the driver to pull over that I could enter another country without having to present my passport to an immigration official. Walking back across the highway (carefully) to our vehicle, I drew a crowd of children with my camera. They were delightful.




Later, I noticed young children standing at the side of the highway lifting up colored plastic bowls. I knew that they were selling something, so I asked the driver to pull over. He smiled and soon I found several children pushing bowls of dried ants towards me. So, I ate ants. They are a nutritious source of protein, great for on-the-road snacks for the myriad truck drivers. They have a slight slight crunchy texture with a slight hint of formic acid, and definitely do not taste like chicken!

Lilongwe, Malawi

It is Friday and the second day here in Malawi. I arrived yesterday in the early afternoon after a short stay at the Nairobi Airport in Kenya. I had been studying the security reports (I receive three from two different sources) to assess any risk to the airport. Mr. Franko, the Save the Children dedicated travel agent, informed me that there were no flight cancellations. I am not one to be overly concerned about such things. But I do like to be informed so that I can make the best decision. I learned this from Save the Children’s security unit and from a brief discussion with Paul O'Neil, whom I literally bumped into while trying to locate the coffee in the Save the Children Washington DC office.

The violence and demonstrations over the disputed elections and tribal conflicts were continuing in Nairobi and other regions to the north. The only evidence that I saw was an increased in armed guards in the airport terminal and even patrolling on the tarmac.

I was picked up by a driver from the Save the children here in the capital city of Lilongwe. Mali is a small country, but very green (during the rainy season) and full of friendly, accepting people. The country is notable for Lake Malawi, which occupies nearly 1/5 of this entire narrow land in south central Africa. This lake is often called the "year" lake, since it is approximately 365 miles long and 52 miles wide. My GPS unit showed it being at about 3,440 feet elevation, which explains in part the relatively cool weather just 13 degrees south of the equator.



Derrick, the driver, took me to the Capital Hotel. At first look, I thought to myself, "This will be comfortable". Actually, I can stand a bit more uncomfortable than this fine hotel - a little too fancy for me. In part, I saw this, because I have noted that the predisposition to being able to converse with strangers staying at a hotel is in inverse proportion to the price of the lodging. Still, I am not complaining, but the Capital Hotel will be very secure and restful before my field work commences, and the office negotiated a very fine rate for my room. I realize that it is prudent to not talk to strangers, but gee whiz, everyone has the ability to be polite when one is greeted. Maybe when I am more successful and think more highly of my position, I will be less likely to press a greeting.



On the other hand it is so easy to talk to the housekeepers, groundskeepers, etc. They are very friendly here and not at all surprised to be greeted. For instance, I walked outside the corridor from my room and noticed a man who had just set down what looked like a heavy cardboard box. I walked over to him and greeted him in English, since I have neglected to teach myself any Chichewa phrases. I could tell that he knew English probably only a bit better than my Chichewa. But, I tapped the box in front of us with my foot. He did indicate that it was full of glasses. I leaned forward slightly at my waist as he looked on, then I grasped my lower back with the palm of my hand. At this, he smiled and we both chuckled. We both understood that this was a very heavy box to lift and to carry. We indicated goodbye and we both walked away laughing. So easy....



On the other hand, when I was asked at the Save the Children office what I would like to eat for lunch, I found myself at the local eatery in the same building. I could hear the discussion on where to take me. I encounter this often as everyone sincerely wants me to feel comfortable and at home. I finally interrupted and simply asked, "Where do all of you eat for lunch?" I was told that a cafe was within this business complex just a few doors away. I replied, "That is where I want to eat also!"

Well, that was my kind of place. Reuben the Office Administrator, who accompanied me quickly pointed out that I could use a fork or a spoon for the Nsima (similar to corn grits from the American South) if I preferred. I quickly noticed that everyone in this crowded cafe were using their hands, which I am familiar with, especially since I travel to Muslim countries. After ordering our meal, Reuben directed me to a small table up front which was empty. On it were two plastic glasses filled with Western-style utensils - spoon, fork, and knife. There was no way that I was going to pick up any of those implements when the food arrived. All eyes were glancing at me time to time, especially when the food arrived. Smiles glimmered as I began eating with my right hand - the correct hand.



On our return back to the office from our dining experience I noticed a sign above a storefront advertising as an insurance agency. It stated that it Offered Protection from First Class Professionals. I know that for myself that I likely do not encounter first class professionals requiring that I obtain some level of protection from their unscrupulous advances. Rather, I probably would need protection from the mediocre grade of professionals. But, I thought that I should, in any case stop, in and ask for a list of these high-grade professionals so as to be on the alert for their subterfuge! I am not totally ignorant that my North American delivery of English communication is the only correct method in the world. Each country that uses the English language has developed their own functional linguistics of deployment. Still, one finds individual humor at the unlikeliest turns and it is best probably spared from being shared beyond one's self. You decide.


I spoke by phone with Amy Richmond who is the Program/Sponsorship manager located in the Mangochi District in the Southern Region of Malawi. We discussed my arrival in Mangochi and a few logistical details. I will have ten persons for my two day training session. This will be great! Later, I also spoke with the Country Office Director (COD) Paul MeCartney. Paul was among the most unassuming, engaging COD that I have spoken with.

Most of my day was spent with the IT Manager and Field Office Regional Technician (FORT) for the Africa Area, Kondwani Mtalimanja. On Sunday, I will travel to this area to conduct the training. We will have an opportunity to field test some forms, and then I will return late Thursday to catch a flight the following day back to the U.S.

A Field Day in Vayots Dzor Armenia

I am catching up on my blogging due to intermittant internet connectivity and travel to Malawi. Last Friday was my trip to the field. We drove 2 1/2 hours south of here. It was stunning. We had to rise up to a mountain pass of over 6.000 feet. All was covered in a light powdery snow with a brilliant blue sky and much warmer temperatures than down in Yerevan where I have been. Still, it was below freezing. Not many trees on the mountainsides, but plenty of rushing streams of freezing water.

The team traveled in separate vehicles since there were five of us – a pretty tight fit in one SUV. We were going to test the two forms that the team built in the Marz of Vayots Dzor. We first stopped in the village of Saravan and entered a building which appeared to be the village administration location. There, we were introduced to several workers in the program here including the Deputy Mayor. Not long after we began the PDA surveys, the Mayor himself came to observe our activities.

Each team member had a PDA with the forms that I had pre-loaded the night before. I had reviewed each form for any logic errors. There might have been a few minor changes I might have made, but these would be learning lessons for our review when we reassembled on Monday. Each team member paired up with a respondent as I observed. Sofik seems to have an innate skill to position herself in a body-language friendly position for the interviews. Each member was adept having the respondent being able to see the screen of the PDA. This is important and differs from using the traditional paper-and-clipboard method.



Not only during my work with the Save the Children, but I have always noticed that interviewers unconsciously place the clipboard between themselves and the person being interviewed. This always seems to engender at the least a curiosity, and at worst mistrust between the two parties. It can form an inanimate barrier between people. On the other hand, I have noticed continually that they PDA, because of its small size, allowing the interviewer to more easily come alongside the respondent. Always, the respondent will at first be drawn to the technological device. This can cause a concern, as I have seen respondents in remote villages ask if their voices are being records, or are their pictures being taken. In Uganda, the PDA team had decided that they actually informed the respondent that their responses would be private and nothing other than their verbal responses were being record in a written manner.



Again, after the initial curiosity of the respondent, invariably I have observed that the respondent and holder of the PDA release from the technical aspect of the PDA. Then, there seems to be a great trust involved and the respondent soon loses interest in the PDA. Then, the respondent is able to maintain eye contact in the absence of the clipboard barrier to concentrate on the questions being asked.



Additionally, the interviewer is largely freed from interpreting the logic of the questioning because of shuffling papers or trying to determine which questions should be advanced based on the respondents answer. This latter is designed into the form through the use of simple scripting. The team later comment on this that they simply had to tap the screen and the PDA question logic was enacted automatically.



We then traveled a short distance to an art school that had been renovated for the community of Vayk. We did not conduct any interviews here, but after a brief session with the staff, we walked into a large dance practice hall. Here were young children, probably eight to ten years of age practicing during their dance class. There were both boys and girls in the class and soon after the music started we began to clap our hands to what Margarita told me was the national dance of Armenia. Well, with all of those children whirling around the dance floor to the lively music, soon I also was whirling around the floor arm in arm with Margarita. How can one resist – life is short.



On Sunday, Margarita and her husband (whom I met upon our return from the field yesterday) picked me up early this afternoon to do some shopping. She has been great giving me background on Armenia, so I am really looking forward to it. The highlight was a surprise visit for an Armenian dinner to their apartment in an area on the outskirts of Yerevan called Bangladesh. Since I have made three trips to that country, I was curious as to its name here in Armenia. Margarita explained it was named such because it was so far away from the city center (just a few kilometers in actuality).

They had a beautiful apartment filled with books (both Margarita and her husband attended university) and two young daughters, the youngest of which was quite shy at my arrival. The older daughter showed off her PDA phone with connection to local television, internet, SMS and email. I had never encountered this particular device in my PDA reviews. Margarita husband informed me that it was a model that would not be available to a non-U.S. market. These I have reviewed from Asian retailers, but never available in the U.S.



It is always such an honor to crosss the border across cultures whenever I have the opportunity to enter a staffers household. These are most dear experiences for me.
We dined on cheeses and sliced meats and a wonderful rice dish. They table was filled with other dishes and especially the bread that I have learned to love. I am not much of a drinker, but we did toast ourselves with Russian vodka. Lastly, I was poured a small glass of Armenia brandy. Armenia is famous for its brandy with the Ararat brandy factory having been established in Yerevan in 1887. Winston Churchill so enjoyed this brandy that Josef Staling would send him bottles of it while the two countries enjoyed good relations. When my glass was poured from across the table, I was suffused with the heady fruity aroma of the brandy. It was delicious and gently warming. Later, Maragarita explained and adressed me as David Jan. I was no longer simply the visiting consultant, but a friend of Armenia. this is truly a wonderful country of warm people.

On Monday, the team reassembled and we reviewed our field activities. Everyone agreed (as I always hear) that the forms functioned quickly, and in the case of our two forms – flawlessly. There was concern over the slower input method of the onscreen keyboard when recording qualitative responses. This was commented on by Guram in the field, which I showed him how to change the keyboard to one with larger keys. Still, paper is easier to write on, but totally lacks the added values of automatic answer progression (skip questioning) and restriction of inaccurate or out of range answers. Plus, the additional time of using the PDA keyboard is more than made up for with the elimination of post-interview hand transcription.

Over the weekend I had synchronized all of the data from the team’s interviews form the PDA’s to the Pendragon form software. I exported the data from the native Microsoft Access data base to more easily viewed Excel spreadsheets. All of the data looked good except for one curious record for each form. Again, you never see these things in the field, but only after post interview data review. The PDA records two additional fields in addition to the questions of PDA device name and date and time to the hundredth of a second. These two fields serve as composite keys in database parlance. It ensures behind the scenes that all records are maintained as unique records and that no data is lost. It was evident from the date/time stamp when the interviews took place – a little after noon and later after 2PM. But one record for each form had a date a little after midnight. Ah, this was my mistake. Those consultants - I had neglected to reset the PDA date and time from West Coast U.S. time. It was recording data exactly 12 time zones earlier. Databases, including mobile databases, do not lie.


Even though I do not consider myself a dancer by nature, it seems I always find myself dancing. It happened on a stage during a school presentation in La Paz Bolivia just a few hours after my arrival at the 13,500 foot elevation of that city. When a natively-costumed dancer spied me in the audience I knew that afterwards I would either have a lifetime memory, or pass out from oxygen-deprivation right there in front of the whole community. The former happened. This experience has been repeated for some strange reason all over the world, especially in Latin America. I just must look like a dancin’ fool!

So, I will spend a couple of days here next week finishing the assessment, then onto Malawi.

The Richness of Armenia

Friday, the team and I left Yerevan in two vehicles to travel for a little more than a couple of hours southeast to the Marz of Vayots Dzor. Exiting Yerevan saw us slowly emerge from the fog and cold of the plain surrounding the capital. Heading south at first, we then took a turn that led southeast which gradually had us ascending to foothills. As we gained elevation, the fog lifted and a brilliant blue sky appeared. the snow began to recede in southern-facing slopes and the sunlight felt warm on my right-passenger side of the vehicle facing the sun.

Before I describe the field testing of the PDA forms, I will tell about what happened later that afternoon after out visits to the village of Saravan and the municipality of Vayk. It is not that the testing did not go well, nor the delight of being entertained by young dancers performing the national dance of Armenia. But, as you can see, the detour to the churches at Novarank was stunning.




After we finished our testing, Margarita asked if I would like to see a church. I figured that I was in for a treat. During our drive to Vayots Dzor, I learned that Margarita had studied geography and tourism during university a few short years ago. This became evident during our travel, since she had printed out a few pages of narrative of the history of where we were traveling to. Thankfully, during our ride, she provided narrative of all that I saw. We now could drive a couple of kilometers to the south towards the border of Iran to view the churches and mausoleum at Novarank.



Soon after we left the highway, we entered a narrow gorge with surrounding cliffs rising hundreds of feet above us. The road was in good shape as Margarita explained that it was in good repair due to the large number of visitors during the summer months. Not far, we emerged into a large bowl-shaped valley that opened up to a cathedral-like view. High to our left, was the church complex situated on a promontory.



I was so entranced just with the view of this valley before me. But I also knew that my life-long delight with history was to be satiated soon. This church was founded in 1205.

When Are We Leaving??

This is how I am feeling at this point - are we there yet?. Tomorrow we will drive a couple or so hours to field test our two forms. The time of training with the PDA's and form design software is completed except for our post field test review. During the training I emphasized repeatedly that what works here in our training sessions will behave differently under field conditions. It always happens that way. Try as we might, something usually pops up that does not function as anticipated until you place the application in the actual context of where it will be used. Part of the reason of this plague of developers and project managers for computing applications is the the designer is expert on how the application works. I recall when I designed and conducted application testing for mobile inventory applications for the Boeing company, I would send out a call of invite to the organizations that eventually would use the application for testing volunteers. Almost without exception, I would receive the expert person who knew how to run the prior version as a super user.



This never made sense to me since they already knew how it worked except for the changes to the application. I frequently would politely smooth over their bruised egos when I declined their offer. I would then make an unannounced call down to the factory floor looking for better, less expert users of the application. I knew that I had found success when I discovered the old codger who must use the application in his/her daily work and who, after some prodding, would vocally declare that they hated the program and it was a waste of their time. These testers were invaluable and would quickly - and loudly - tell you what did not work. Usually this person was as close to the actual process and was indeed the the true expert. Free cups of coffee and donuts did not seem to bias the results.



I am not entirely sure where we will proceed, but Margarita assures me that we will be able to visit areas where both the Community Self-Help Fund (CSHF) and the NOVA programs will be present. The latter is a partnership funded by the United States Agency for International Development (USAID) as a five-year initiative designed to improve quality of and access to reproductive, maternal and infant health care in rural areas of Armenia. The Project is managed by Emerging Markets Group, Inc. in partnership with IntraHealth International Inc. and Save the Children, and in close collaboration with the Ministry of Health (MoH) of the Republic of Armenia. I am here in support of Save the Children in order to assist them as emerging as an innovator in use of mobile technology.

Now here is the nuts and bolts of the issue in my largely ignorant and simple understanding. After the economic collapse in Armenia due to the pull out of Soviet Russia in the early 1990's, things became rough for everyone. No jobs, no taxes for infrastructure upkeep and improvement. Around 35% of people in Armenia live below the poverty level, while 6.5% are very poor living on less than $1 a day. The last time that we experienced anything akin to 35% unemployment in the United States was the Great Depression! From reading the success stories (I dearly love them, especially the Save the Children's Directors comment at the dedication of a renovated youth sports facility in Artik town in the Shirak marz, I wish that the Sport School gives many champions. Champions indeed - of the future of the community). I have seen the world over how people, especially women and children, spend much time and effort hauling firewood for heating and cooking fuel, as well as water for cleaning, cooking and hygiene over long distances.



I recall how busy I was with my four young children at one time going to work, coming home to do the laundry and cooking meals. this is not to mention the other tasks of transportation to soccer (football) games, etc. Well, I was plenty busy without having to haul stacks of wood on my head while carrying a bucket or two of water a few kilometers in the dead of winter. I sure enjoy hot showers at the turn of the faucet and electricity upon demand. I will not describe latrine situations in developing countries - flush and go for me! Now where is that secure donation website link?

So very little relatively goes a long way. I will post pictures and narrative in a couple of days so you can see the exceedingly fine work being conducted for the children and families of Armenia by Save the Children and the partners. The newsletter that was produced by the staff of the Armenia CO of Save The Children before I left the U.S. was delightful and very informative.