you

unlike the previous one it'll be recorded and transcribed data available on the website

it's pretty interesting do

and it's a searchable so this is said to be in the spring now try

the boundaries together and what are more about how you can learn across different media

now using technology will have a presentation on

interesting

but the data is about adaptive management

however

great thanks for having me one thing else a right out the bad as

i'm coming at this from a very

i see narrow and deep

but sure perspective

and i say that not to not discarded but it is important to keep in

mind that

you're worlds or a lot

i said

bigger than mine

so my goal here is to share a bit but also i need your help

to kind of share what's next what you'd like me to talk about so i'll

give you some perspective and a couple of examples in a pretty nonlinear way and

then we can we can go deeper into specific parts that are more useful to

you

i mean that's so that's the goal so i'll attempt to do a presentation and

then we'll

what kind of jump into a

a conversation

e

and that's mine regular

disclaimer that every time i present one of these things i'm

i work at the number of partner organisations are sick or texture attack anymore distrust

was contract number organisations around is tougher guess so i'd i wanna make sure that

i'm giving them credit words do

a lot of lot whatever present as always

a combination of

of different

mines

so that i

so that the presentation area double context

talk a little bit about the principles of adaptive management people move

attended the mic going seminar last year or nine that we might be some similarities

and then we're gonna have three examples of specifically of adaptive management in practice and

we can

jump back and forth between the examples in the principles

all

context this is i think getting fairly common

vernacular

is

complex first is complicated

interventions and systems when intervening that the quick example

like to go

to multi-core project inter mode a

and talk about the if you all other movements of goods and services are gonna

draw

that you really have

you don't wanna

looks roughly

like that we don't come on

but

and

that region

that's german so that's

right part of the used

very isolated

how the history of conflict

and it's a it's at fast

regions of the news the us to develop such a way

the mean you heard the

the development process

program are used to use it is different from

the last

but you have come on here

n is what i really quickly and this is gonna be

second of all problems the cost

so

so for contact this is

so

and that's the rest of this

so

five state of trends it

to fast or

and individual

i'm component

raw cost about and

thus

and

real to him

ten dollars

clean to consider

i don't

could you do this

six dollars

one can you know

twenty years

can be an estimate of the

highest prices products and services uses almost expensive

proc a section of formal

coding workbench so in is data

in this town can be a place where already is extraordinarily malnutrition extra i

the present conflict

the number of issues

and the one retailer and you're

really runs a small area has to do for all around four

two gabor

in order to is wider small store

i would just complete that's i mean that's the cost all

the number issue

by contrast if you spend about fifty percent of for money on a row on

channel and fifty

okay

there's a number of different factors that are that are involved are there is a

terrible role not work

there's no wrote this entire

there is also

three pretty large stigma associated with caramel to a federalist lifestyles are generally down upon

there is a history of conflict which people are a little bit afraid of entering

the region

and there's also been large monopolies and the north

in the bottom

with regards to especially transport feel

so there's been

individuals that are that are kind of powerhouses for owning in controlling the log space

so there is a highlight that is that

when looking at this if you

one of the programs that we worked with

numbers in a particular program up in northern german to

there is one of the programs goal is to

improve the movement of people engage in the region and reduce the marginal cost of

doing business that's a that's one and

one objective

and for that there's a number of different activities taking place in a highlight two

one of that is some very specific

targeted

this is a problem

roughly what will i know is created

a little so there is there's already a role here is already has really you

know they're zero that kind of oneself here and is used for isolated

but i mean

there's another one that goes down here as isolated

this is a very short stretches to make to turn was an existing role network

into

into a loop a and that is

naturally example of a complicated activity it's

you get the right or if you deal with some of the you don't government

becomes a complex but

in essence

nineteen the contractors making getting the robot

is complicated it's

following steps as reasonably predictable that you're gonna get row

improving the cost of transport

and increasing the these

the movement of people and goods and region

is not a complicated active it's extremely complex it's

it's about social dynamics that businesses

set and one of the experiments that's currently underway

is

two first of all worked with an engineering from income all

to retrofit buses to run on roads inc

so that kind of sorting out forms that are interested in designing new

right refers that are gonna be able to withstand the rugged

i training ones and flooded role six r

and the second

search out transport companies

perhaps interested in operating impostors on that look for

and third is to try and convince a bank to put at a capital asset

low on that uses the bosses collateral and what that does

is that if you can if you have a bus company that's gonna

run a service up intra mode

the last thing you want to do is

distance and about them from correctly

a so if you have if you're involving a bank can you not providing direct

support your be the backend

you guaranteeing

if a bus if the any company fails to operate service

the bank will be claimed class and

so that kind of putting instead of structure that but that's an experiment

well known a few years whether that actually works

but that has the have the potential of severely decreasing

the cost of transport

and as all these

not got effects of ideas in people moving goods moving costs et cetera so we

know it's common however

run through the you and your

transport

proposed doesn't work we propose a work it's all the back

is the

so however

so suppose your boss company and you

you are you been selected for this project so you're giving kind of prototype equal

and that vehicle is given in the form of the capital asset to back out

because with the companies to do is in each operation lattices are used to hire

staff and you stupid systems in place in each market itself rather some promotions them

i need to do a one week free

free service around so that people are people get used you to writing it except

so there's no if there's gonna be a bunch of investment front

and the idea is that if the company doesn't make that service profitable the bank

can reclaim the bus because that's the collateral the perceived for all for working capital

so that way that there is no

the company's not receiving any if

kind of free

then i do not gonna runaway freak

a natural so that's and the idea is to dance figure out well if we

can convince couple of operators to move up there you're gonna start also having a

ripple effect where people see all those proper to be made in transport increment

it's kind of the larger and that experiment like cell there's number of others but

the idea is that

to change some of the business perceptions and dynamics around

working out there

a that is where you need to you to play around us when you're building

infrastructure

we have the tools to do your activity plans and

charts and budgeting in we were very good as a sector

we're not so great a managing for that experimentation to

two words and how come of

movement of gets of people

so that's nowhere coming from a project environment where we're trying to

to do mix of different activities to achieve certain outcomes

so

but with meta data management is

in terms of how you build an organization and eighteen that's able to manage for

that

and a couple of couple of key pieces that are put in here and we're

gonna jump into an example in come back to this

so the first and foremost is a nine different cultural messaging so if you walk

into to the j she office

that's the name of the program in term of j

if you want into that off if you're gonna see a lot of just very

quickly gauge stuff

other people around whiteboards people arguing

a lot of data that in mind

so not all that useful

a very regular trend of information that's coming in through

in house surveys you know

have like a fair bit people are there

a much longer than they need to be and that's not

necessarily good or in san device but the idea is that people are highly engage

with the topic of their work and first data is not just a job

on

that's that there is there are a lot of tools and processes available but they're

not the they're not the u b on and all of your work so

you're not required to the remote reporting requirements are fairly small

the number of different things you can do want all that is just a fraction

reviews

there's a lot of tools in the toolkit but they're not enforce does you must

use them there is that all here's here whatever you need to do your job

you have these resources available to you

in terms of management there's of the managers are extremely efficient that's key including the

program manager is that there

a very into kind of the day to day of the programming i think that's

questions not being an answer provider which is key as in terms of sending messages

just after we're trying to learn together try and figure out well because we don't

know the answer how to achieve this outcome

and then

planned targets to missions and i think this is pretty c and i say like

let be if you take it

the right way

is that i think the targets in the n t and then is very important

provide an outcome level we need to make sure that we're

were achieving the outcomes of serving the poor

which is the ultimate goal

however

when it comes to the day today activity based targets

are very useless

because then it makes the subject of

the

all subject of a job becomes achieving the activity target as opposed to achieving the

outcome of say increased people and you can at least increase for people and get

for example

so will be found is that

on the day to day messaging

with stuff

having a very well defined mission that people are very clear about to say on

the animal health team which i'll talk about later on the mission is

to improve commercial

veterinary service delivery in german

and that estimations we define different ways of doing that and people have

we that allows you enough toolbox to experiment and without going completely off charts the

i mean there's a wall and as can be a little bit more defined another

indicated attached to that mission but really the goal is

how do we improve commercially viable

animal health service delivery inter mode that's happening to look actors and the static and

then played as opposed to

train x number of better right

doctors they or whatever so if there's no

the mission is all of the outcome level and we don't talk about targets of

the activity level on a day to day

those expressed

so that so that's

he is intonation part

and then you talked about the toolkit

one thing i'll give an example of as well as

results chains are useful if people order those changes and

it's cannot of the dct and the end for you world

as kind of a sequenced indicator based activity and it very saying well if we

see this happen and this is the indicator

attached to it then you but you this result and then that unlocks the next

afternoon move onto

to its kind of is it's a very explicitly out of your teary change

and if you don't see one level happen you stop

and you river and have to revisit and revise

but i say that is like an option because results tree i've seen programs not

use results change do great work is low the general word of like to use

as disposable outcomes

is that the lower level you're saying what we want to rethink that if

we work with the number of wholesalers to improve in proc

product delivery by

having a preferred distributed program whatever like

whatever the outcome is

okay let's set that outcome and say for what for the next quarter of the

next six months

we're gonna in to have

twenty distributors try this or achieve x y and z

and if it if it fails

then we dispose of the okay so that's the difference between your higher level and

any locked in

indicators which are important in the outcome level a sorted ultimate outcome level but on

the day to day having disposable outcomes that

that don't show up in the in your in your performance management are equally important

because it allows to learn

in house style kind of targeted

surveys but done in house because

kind of contracting it out a is expensive and b i doesn't really get the

critical staffing given that you looking for

so when stuff are going enforce to ask questions as communities and forced to

investigate an issue in talk to number of local actors

it has the implicit effect of

of creating curiosity of breeding curiosity which is been really useful

and not to mention you get good and useful data

after action reviews

sorry one thing actually mentioned before rewritten a lot of the stop in a recent

a study which we've got copies of for you to take with us there's a

lot of detail i in that some kind of

with you know are independent out so i can send you the electronics what the

electronic a set of training a whole bunch since we know how many were coming

electronic

after i've interviews kind of coming from

is there a widely used by the us military but also used by the number

of different you can innovation type organisations

and

taking

and those are basically what was after an activity argument meeting what was intended what

actually happened

why do you think it happened and when you need to do next it's kind

of

it's a forced reflective process

and

what we found is that they be useful to some t

in some points in the program the less useful at other points

so you can have to say well okay maybe should do an ar

and teams will tell you

which is also great particles using no i don't think there

no not useful

and then distributed management of short-term work finding

so it from another project in southern you gotta

we have low we have kind of thing that locally

disposable outcome type plans that everyone is rather eat around

you are personal plan

is designed by

so every week the and every individual on the project

comes up with their own kind of okay through this weekend focusing on these are

the outcomes and i'm focusing on

by doing these things

on this is wise role in for me and is what i hope to achieve

a and then you kinda you can debrief them everything to say okay it happened

type

but by putting the onus on that stuff to plan their own work load it

also increases

relevance of what they're doing in allows for that flexible

so that the

things here that i'm not gonna

going to dive into a lot because i'm and that's just talking about but i'm

gonna put it there are just so that if you want to touch on in

the discussion we can organisational structure physical offers infrastructure layout spoken about four at a

like a links and then

staffing so the people or higher how they require a interview process is very key

and then how they're inspired encoded mentor i in terms of

regular conversations about their personal growth

you really kind of feel make stuff feel involved in any engaged

and then performance management us a lot of the competency frameworks to be devolved which

are available online publicly

are or

they have a any explicit learning in creativity component looking at well

what and what degree are you try and you think what degree are you are

you engaged in learning

and that is a performance measure as opposed to just results is also a performance

measure but

and not gonna are not gonna

die deep into that and then if you want to talk

both a couple of examples and we'll and

which one inch

so we have one of the programs to joke program

there

they're kind of goal is

if you didn't business models in the agricultural inputs industry in you gotta from being

a

very highly trader oriented one

to a customer service and solution oriented one so

but rate oriented you mean

by the lowest price possible cell highest price possible is predatory short term and it's

gonna

these results of that is that you're change and program that results and in a

much less dynamic system that is serving farmers for example in and it also allows

for counterfeit products a to seep into the system because no one there is no

incentives to develop long-term relationships

so moving to a solution focus mentality

where support problem is coming into a given area

and the past is it

in fasting a field

as a as a retail input retailer your job as you is to deliver a

solution

and because they're your customer and you that's the mentalities that's like kind of the

overall mentality just

and then to do that

to digest taking audibly

those disposable outcome type approach so they

and have i have the new

i just got in my inbox yesterday the results the your three

activity planning and reflection

review process

which occurred last week

so it's a new set of outcomes some been dropped some been modified of the

bad

so is really knew what out in front of me is kind of your one

your to your three and how the outcomes of all change

i'll for example a one point

one of the experiments was

to try and

increase the amount of

services that i ct firms offer

two inputs businesses

in order to

kind of and then the whole idea is just to do a whole bunch of

things that are targeted to words

creating this customer centric mentality so if i ct from the marketing themselves in this

is with a cell phone based customer feedback mechanism that creates more energy in the

system

due to push the two words

at a custom oriented mentality as opposed to train to one

so it's that's the idea so there's lots and lots of buttons like that so

one of the activity that took place is said well what if we put out

a challenge grant that

let's see what comes it

of and i ct from developing new product that increases

that the target customer service and target the inputs

got back ideas send them for feedback of them back had a few and a

few iterations the ultimately

it

that didn't work out like the idea is really bad years difference or just searching

for grass take this just had very common behaviour

but i mean that initiative failed and it got cold

of the plateau and in fact at this point

i ct from aren't even an outcome because they're just generally written them off

as a useful entry point

but they were there for a long time and if they were part of our

official performance measure that would then the problem

but they were they were disposal

on so i recorder there is a review and every year there is a review

the your to correspond with

you see ids budgetary requirements that leads to meet that and then

recorder more informally

so is useful to do another example or should be just chat a bit a

can get i and seeing that might be some questions summary not might not be

hitting all the knots that potentially should be so maybe we can open it up

and i can be done to more as we talk

well just from and how to say i help me

a million eight

and stress that were assigned he's

right so they were between

to actually get is not make money and in that state and that italians ran

into you

perception from clients s and how she tradition thing

note that we're trying to push

in our data care wire that i that is just and anymore

you know why i know are like a writer's here so and the same thing

at just under additive that i got of l

amazing how much faster

so the reception is very don't have that much money and

wonder whether this is being

s is really a solution or something

someone's just

actually

in order to get

to something where

in terms of better days or something like

it's data collection

i know that so are

theory behind more than others behind

i don't while being a key and you point in term budget

is that

that's a primarily pastoral speech

housing goals of primary sources likelihoods and i don't mortality is really high and s

and we did a pretty comprehensive study with the five stein centre before starting

which indicated that

i and this is we didn't notice before was assumed that i don't higher mortality

was because of calibrating in conflict

but the reality was it was just sees

so that was that it is reasonable if there is an increase in use of

animal health care

are there will be decrease bossed of life

is that's the that's the intention behind it but you're completely correct like maybe

there's a consumer choice thing in there as well or perhaps a public provision question

a lot of that should be a publicly providing good

and completed a right ranchers the eleven year round

i just i may see your star

so

there are a lot of three vaccination can instrument but you got incompetent

there was an outbreak a foot and mouth disease just earlier this here blows up

there

a and there was rumours of a quarantine but

i do not actually according

in place they should have an anyway but

the government responded very well i mean they did channelled

don't are funding actually in that case and that was vaccines delivered not expectations are

so it does it itself

efficiency and effectiveness perhaps

so we're pixel by which group

and so we're always faced with disposable cups versus

fixed outcomes

by doesn't use the terminology but to

post filtering approaches to look at have

intermediate outcomes they're called

which a change in all the time knows the project

denotes the c

the opportunity to see some

outcomes can measure were someone comes a more appropriate

personally i don't have that trouble

the same reason to talk about your experiment in the tried several works so for

someone colleagues

by which group

where project stuff for the

the problem i have as with this fixed come at the end

the typical project a problem with him back projects is that the fixed outcome

is to english as it can be measured it's to all the place

so how what advice would you go to the right to a better focused

six tokens

we can be measured and the

as a bilinguals we can hold accountable for

and you only could answer the question

i

i think that and i mean one question that would bring to mind immediately is

do those fixed outcomes have to be universal or can they be specific to in

country or region

well i don't talking about by projects

so by project will have sense of a component in this project amida just look

what sort of the u

outcome where the objective

is part of it is improved productivity of the business sector

okay so that it's a good measure that is how would you will refer to

something

so it's the higher level objective of the project so to achieve that are doing

lots of different things are doing the kinds of things for measuring the banks to

business

assessment of things like reduce about times text on business and so forth

but you are doing some work no export compared to those troops a better product

standards conforming to the actual products so

but also the one called disposable income because some of those work out some of

them don't work out

all

but this final objective of the project so improve productivity a couple of other things

that's workable problem because they tend to be things that are required to make sure

and things the to

you know the bank is not the only one that's

could influence of the attribution is an issue

there are lots of problems but i think it is important that we have to

have something

the back is going to be accountable for

and so i think that's the area were word bigram open stability in the other

agencies but this way

it'll help there

i will just after that this task

by which i

we don't know evaluation

we can better

perhaps

the more formally are about performance the better we can project outcomes

so i do i

it was before

are committed to

mass market

i just

just performance for your in fact

and so each question regarding this process you got of what mechanisms are place to

measure performance

that's a pronounced are fully integrated design right sure that would be very useful three

those so

so that we say

it took about three four months of conversation but it at the beginning and it

was a great conversation i think that were also we were probably should have a

mission

but going to have a conversation we did decide

to remove all former level

impact indicators from the projects of responsibility and it would make sure that in i

over that already portfolio different projects there's three don't independent projects and you going to

one that's

that's the inputs one that working with and then

there's one that's focusing on commodities some more on the that's i

and then there's enabling environment

project doesn't you know all c reform and us at you going to agree to

measured the form a little impact as a as an overall overarching

i exact evaluation which was fantastic so for us will be responsible for is an

increase of

sales and usually of not utilization justly stills puts more inputs are flying that in

a decrease of

of margins

is one of the indicators as a whole bunch of it is but one of

them

is more general on a long if its distribution chain

because there is a spike

at the former

and y see that

that get lord and then increase in

if it'll abilities as graphics go up there is a decrease in counterfeit thanks to

those it's there is about

thirteen unique

for the usa for measuring plant that were

contractually responsible for any the only excerpts that was really it was a conversation took

a long time interaction contractually just

in an for example

and that that's something that's really a call

sure

and i think that's where story really interesting to is talking either word as well

so they're doing these experiments there figuring out what works

what does not work these disposable outcomes are probably generally loss

so what does not working for us

no one in real-world mexico is everything here about that they're gonna try to replicate

the same

at what they only view

and it how can we

i think that's

and the impasse given right of the attention

but it's only small outcomes where i think all the only is taking place

and how we can

still that are so that people and they are

because it's a waste of resources to bp those that's over and over and over

here but that's what we do

only someone is tried something similar with bus companies another batteries are maybe

where

different a housing in the m is the same how do you can ask you

only the people so that you can

these issues come over

right

absolutely i think there's a balance there because a lot of the time coming from

complexity theory

and the moment that spent so depending on kind of the history of the system

and the current state

something might work somewhere that doesn't work

you know places right so that's

but there are some common out that words learnt for at least word understanding why

those disposable outcomes

but was tough place

and you can make kind of a context based decision but that's relevant i think

it situation

so but that's

so really good point

so i think you say something that might

you mean for years result by the way

i don't know is it can tell from this side so huh is okay sure

i'll put something out on the screen with the caviar that this is just something

i did

i

definitely not

which works from

i tried to take a look at band right views were used the most instruments

and

we can this and i didn't

so this is the first eight months

roughly no first year

what is your implementation so visually the program actually started in october of twenty twelve

but then staffing analysis et cetera all occur before this is all stuff were in

the field and working at this point as the resistance

six years like around the time we're status no idea what

so that's were also i would say the highest level of experimentation was taking place

and then it completely even once they can define the results jane and really started

working on one and then there was another

quarterly review at actually there was a quarterly review you know to rate around that

spike

and then there was another review in

just before last term so many

so that was right ready and a strong

so i and i mean i could go back on minor jack because all of

them are digitised speech

to go for

and of the questions are in the global formant people in just go in there

and then fill out

i will cable would intended to participate in what was the goal you into g

we did user why this happened what happened

and you submit in and

all staff of access to the in going to look at anybody else's i

so that was so there's i mean there's bikes and then i spoke to stuff

about

why that was the case and the syllable is not used for just that really

was not so big question and this is an unresolved question is that how do

you figure out

how do force it to happen when it needs to happen again

because it will need to happen again

especially when kind of the current initiatives in current pushes and mostly associated with the

season

so once the rainy season is and religious right now

what people and what we didn't work sitting now's the time where

lightly stuff need a little bit of the k two

to start thinking you attribute again and

jane seymour ar so it's contextual it depends on management you have

i i'm a big believer in

in good hearts law

you know when to measure becomes a targeted fill to begin

which is like if you is just realise process

it becomes less the purpose behind the process gets lost so

as in

it would when managing think how do you do that in a way that appears

in helpings to show less

as is gonna give a choice but i

so that you kind of genomic exactly

distance

sorry you think number so weighting

timing i in phase

six fine

well so it's a cumulative

it's a is a cumulative over time

so you have to action

for forty five and primarily done by t

i mean you think topic something different components right okay

and i also tried to this is this is where i'm not an evaluator some

their young triggers

i looked at the average number of words in the what have you learned part

of the review and tried to see if it is consistent was fairly consistent across

the teams of like how many words they were using to describe the various thirty

five

average

but a weak suggesting

definitely lead to completing an activity and it can be efficiently not state

no so it is left up to the team and where people call last is

every time there was a major each action

in major meeting with the government i

and the cost here a major event then brought together traitors

anything that was more than just at

just your regular day today

so i that that's probably where the holstein actually interestingly enough use the abstract interviews

as i kind of correlation tools as well

because they're spread across three districts and they're working the government

so that they kind of needed to know who's talking to whom and seven

as they found that the properties that is a discussion

so you started by individuals are killing or

with the team the error rate or

is there really small laser units

so each of these teams as

three people

it's really small

pretty fast well yes you know what people are i

i'm how long as there are processed

have four

and what you get at all

absolutely i think that's where the can really the national messaging in black women to

you hire

comes into play

there is

i mean i think in every developer program and this is

i around the side of caution when it comes to

money's sake

i think there should be very limited access to decide

anything i think in this program choose partly index page

at those of the two people can decide what everything in there is a limit

between the two

this will and i think that's a necessary because there is a danger and extrude

quantity of finding that syllable

but

at the same time

there needs to be a huge amount of come for

first out to feel like the incoming talk about an idea

with the manager without feeling that there

that

the lower feeling intimidated any issue

and a lot of as a role modelling filial role modelling yourself

kind of opposing ideas yes she's have to be

very human stuff so there's it is a fine line

so how predicting an initial or if you

and if you can imagine what we were can hang on higher predicts that are

based on a green light

i do describing effects how exactly things like that splits angry i have something to

work i just haven't i know that and the freedom to

and i know i you know that management when you know that i don't see

that in your you use a contract thing to

this someone

send

we do

the problem can

mappings

right

that comes to a or whatever

known to

the selection hindi

you have unit or what it is important to

the principle

because the

for what we're probably we need

you miss for all the

for sure

for sure and it's i mean it's an ongoing and i think this is where

you enter the soft realm of relationship between

don't implement or

and it really depends on how you navigate those conversations the individuals involved

and systems available to use i can give you two examples from here is

i used to thank and i am saying i used to because i don't think

of with this anymore

a strongly

the cooperative agreements

with you see id were much more flexible

phonetic instrument but this type of program you speakers

you have a kind of shared about control between measured already can

the budgeting is a lot a lot of loose

say and then contracts

however the time to take project that's functioning at c

phenomena i is a contract a and that was this is just a great

see large okay that's

the their the these speak all the time they're onboard and they also the plan

to

the in order to things are gonna change so the budgeting is done not based

on specific activities but a little bit more on the dialogue so there's

the but the budget lines a bigger

but fewer of them

and so in there is a that that's ongoing conversation but it can be done

i think it's to more about having the right

i an discussions that the error like that this was not all kinds but we

can see how kinds that are more

right i can avoid all

to see

something

suppose that when i

that position there

it's

one of the things you well we found then depends on the outcome

is we sometimes look for this is now looking purely in a market facilitation axle

account grill

is that we try and see

once in a reading with the business a be supported them with a certain number

of activities if we now stop also for what happens

and that's the definition of whether a success for us is able to recall sharing

on promotional joint promotional that's for

for in the steelers just to

do you can

capacity be reduce the risk

of investment on can small-scale retailers and also there's

to do speech reformers and then go out to market days and setup

events and actually the promote promoter products and information

and to reduce that risk we give stable if we

if we call share and then

for the first one or two and then we can talk about with that this

is how affected that was

and interchange mechanism because the business find that to be a profitable to the issue

i do you taking them unless the

that's so in order to test that you just for tract

watch for a few months so you can where you're working with other partners you

doing other thing you're not doing anything that

anymore and then if x doesn't work and you can start getting evidence to are

saying that was not a very useful information

but you just go back to

really point much will be role to search more complicated

i two pretty straightforward

my experience is not true in every country of one example for good ashcroft work

to sort

and

they're by works two little works with the ministry

rules which those national

rose

non-words useful because the local government engineering department those roots

we propose these agencies bike

to build a two colour operational risk assessment

try to figure out what we're three

managerial shoes that would affect whether back operation would succeed or fail building roads

and the little all the kind of this is processes

in each of these two different organisations so which are

but it will actually engineering design

you're emotions

a crossroads management's various types and so forth

and they found that in the beaches syllables an actual roads

the risk were so great that the by just couldn't work with the ministry social

darpa program

whereas with three we wrote agency we found the roots were manageable little to the

agency was really will lead to the things that we do in order to address

also think when the second

operation there

trouble is to get to the rule two d mesh well that's what happens amount

of the large so this wasn't sure that because this

role buildings there is can be can were also we cannot construct good

i would agree and i have a propensity for calling things complex

i see the complexity in it before it is you the complicate is that's just

as an example

when you've got all the politics in the social dimensions

and i don't question about the actual content of the after action is i and

then much like to do that i

i was wondering if i don't know if you've had a chance to

i one at prosody not that

i was wanting that in terms of the content is that's consistent things that and

were identified as not having by myself okay patterns in the challenge happens in

solutions even in a strategies of how they without the right so i'm probably can

question very well

and the reason for that is a not

team leader is a small team so i so for example in the l t

i i spoken to know how you would be a team leader manner

really in proc

she she's princeton out presented you need to be roughly a week

and d discussed it and whiteboard in figure out of the patterns are right shows

that they are dating

and then information conforms to weekly yes i do the weekly hold it can sell

so this is kind of two

one

well

and this example as i paint included in that had yes so it's

the s is what result you working on what success looks like what do you

try this week

what we're signs of progress negative side we didn't work

and you to try x a

and that's so that comes out of each team

t prepared of course

well

the offencive results shown

and

roughly every for six months

on this program

stonewall process

i'm sorry cluster

but this one's mercy corpora to check yes there that's

the outcomes are

very that it did not standard format for work that the city will this one

sure which is really for and the resulting probably visors to the doctor visits a

lot less often

well i mean just

just natural it's a it's a for each way

so

i think there are involved in terms of they have access to

but it's a little bit less delay and so on

yes i mean but there is a there is an for

i do quarterly report that's

for normal and the device results change

based on your experience making a little bit about

christine is groups challenge

the bottom two levels there's

how do you promote individual during this way so how do project he's economies characteristics

so that they're running and stuff

and then there are challenges how you at a scale well that it will arrange

their institutional

what are some of the cr characteristics of people really take the start i guess

station really take this are they get just the way that they do business first

how c

does anybody else

i and

that's true that's true i will be these two learned like utterances it's that's a

very effective

set of principles

i mean i think you have to demonstrate the utility that'll develop have "'cause" i

mean if you're not you it's just like i think your try literature

kare

just a scalar actual signature

is to be demonstrated that it was for the onset of programming and even though

you saw fall off real suspect worse still solve it addresses

with the with this direction

so we get drilled out of it and cy that is areas

see just what happens

why certain g

well that's

what was the impact of this on roger

right so that it is clearly not with roger

i very

i think so too

as i think so too we try to qualify this

for a colourful it's a just describe the form in that case study but not

so much the latter

it is to let me and it also

entering your three in october

i first

and

i am i how they are defined

so there is there is a just a the one of the big

initial and final evaluations that that's one p and p and then the there is

another very like there is a really interesting set evaluations that are gonna come from

right side

because when we started off

we said we don't really know where or is gonna be

cell

the five stein center came out and did what are the most

kinda

and perhaps not as figures

initial baselines i participatory baseline something called it a and it looks at task it

goods and services

and ran very experiential focus groups

all around term budget

looking at how important certain gives are everything from retail goods access to

to transform to energy to like just really just blank it

and said what's more important was less important people what are people's perceptions category c

d availability of certain things since it is an excellent e i is unlike any

study of that

people using stones to try to look at her movements

and see you cut out years in people's perception have

about the size of the words were all are

and they perceive them to be feature like this

kinda trying to correlate

people's perceptions of reality and

and across the whole spectrum of topics we're gonna have another one those

in the middle

which interesting to see how that changes

and then we didn't do activities and probably fifty percent as here is that there

were evaluated we didn't know

as the leadership inconsistent

right

it has been so far

the data are gonna go through translation

so

i and the design was

the present in

let it for the first for years also design project spent two years

but the rule changes not to all

to change and principles a real common seven principles as

that the project by

you said that the mission doing so

so that a evaluation or a broader direction is just a more so system or

kind of traditional indicators household based evaluation

and so i mean that'll be interesting but we also want to get kind of

this all the level of qualitative data

i just to see what changes

an interesting approach because i to make sense that you

do impact evaluation project level someone doesn't make sense because part is by definition are

necessarily having the prior

right program of

projects the are expected to have

the interesting to see that they take it approach to their evaluation as well

is minus n is the bank still tries to do impact evaluation at the project

the whole

to various

various programs

successful

right

right

what are is there anyway

in that easier

it's an adaptive management

so this i mean there's mattering the and there is more and more that are

there now coming to are so i just of the speaking with the

been more secure is really great to

to catch up with and learn what over these past few years they're trying to

find the same approach in liberia

the group programs is the first see that funded all and for p programs it

should be interesting

due to see where that goes into there the caff your everything

adaptive management have really switched on a set of folks that are there and the

ratio so that would be interesting to watch t just are there just started

there is

can you mark distrust is another want to look at l

i think that there there's been a bunch of changes in the distant funded market

access for us not up to date with regard to where they are right now

but at least well as their

they're fantastic

also adopted similar kind of the adaptive a structures and

taking more experiment

or some other ones i've heard so now this is all your things are supposed

known things

there is a program to all cost a marked

no fall it's implemented by

it can sort through the springfield

and a bunch about this practical actions as well

a there are also the they actually released

is a case study that that's a good companion to this one that's both think

i

is and the kind of camelot you're the two we're using

and there's

both similar and different so that that's interesting one

to look at

it in a t i you know management comes from now

i don't from q or how the that everything you know it's that you know

in managing

i

because i mean to and i natural that's i with working with fish while i

fifteen years ago anywhere

and management

it's a man i might have

there was your approach which is adaptive management for

maybe a little bit about added to the starter

which one parallel to it

but they do a and another a colleague of mine just real paper

that

that takes leans started principles and it kind of license that of all the spectrum

happy to show well

i maybe else then all these resources to refugee there are in line with a

dog filters it is a little i mean they're all

so clean started a properties of the philosophies that

the quicker you make all the mistakes you need to make at the beginning of

a starter process the and

but chances that you're not gonna take

so that a silicon valley i mean coming directly from silicon valley startups is that

but so the way that they don't eight throughout the business

find as a business plan the first kind

sept first segment of their

what they do is begin okay

in the first of all that's

but there are the about the minimum viable product

which is the d kinda

lowest cost prototype

that will give you information about what you customers really one because you always come

into a start up with an idea of what your customers

a or problem that you want to solve on but often times you haven't already

come

so you come into you design a minimal while product

and then tested as quickly as possible do you gonna more information about what

what customers you cannot like and based on value product

as you generating a lot of intelligence very quickly

and

taking care of a lot of failure at the beginning no are intentionally and then

you then you get to a point where

so it okay now going to

power to invest heavily in one for type and

so that's where departs from to because

with

but because with the lean startup and we'll talk me talk about that in the

paper i mentioned is that

with clean start of the objective is to get to a product

that can make money as a development that the objective is to is to just

make intact and the four

so this so that there is a departure there but at least the principles

it beginning we have like you have a rough objective in mind

you need to generate a bunch intelligence you have to kinda get there

this principle useful

they also talk about differences to measure it engines of wrote well

and they have a whole bunch

settings for

i don't know if the if i

sticking to say or even if a okay to read that it may be but

it contains

you can adapt their cost

at a rate

is true and i think we need to make sure that we're not doing with

with our experimentation but the experimentation is necessary is not gonna get

or without

and then it would be interesting to what across the l c have a phrase

like right natural resources are a series where

well i landed

animals and made by something vol

and engineering probably management i

that's my back so i come from environmental engineer that's wise

it doesn't make sense from a career perspective but from a foreign concepts like to

that's what was couples

collected was rated of the teachers to

it's a experimentation but has a lower or whatever and i think the fight in

practice

we tell managers well the experiment or by dividing thirty gives on

when you be like how a so that our experiments

it's not just well that's trying to support a see what happens but there's this

major state that the data we decided if you give this particular take a decision

it's that will refer to this for experimentation it i think a thing is that

reminds me i resolve the quality management that schools in order where i was i

try to take a quality and it cannot was quality circles and always they totally

did only with regular of

the statistical side which is where all day

i mean was a statistician

it all of this

it is speaking this really big thing was

had no it because you think it there

at experimentation

is the high potential a falling into that same where people say the right all

these experiments

but there's no reader to it is so data collected data just making decisions like

they did

anyway because

well i can see that are not easily there is consequences to properly prototype bridge

we wanna make sure

you know that triggering it

and apparently extending is pretty guy trying to say

at least in of teachers state

that is sitting down and if it is actually to adjust my right okay that

a

so very difficult because of their positions in of itself right although it sounds good

okay try you know these two

to the eighties way is that it is you know

it is there a way landau rate and style this like a data that's already

there and maybe look at different ways that different sticks to it and see how

state and the effect

can you get the information you need without

having to me then i think we define i will doing something

but can you is there is there are opportunities to experimental side because it possible

to run experiments with probably station or i something that doesn't require the amount of

political and

time investment of creating tree structure which is very process you break those with knives

you know can not

and things and it's and you try to find hey give more exactly

work

a that the method in thinking something interesting detecting connecticut

i a

i mean putting that any difference between you know what in an application okay try

okay i think marketing a good right

and not tell you we can

okay

so that night

well but obviously to some extent it might be interesting just like i think that

i think that predicts that between okay shining

just for stationary in scenes and scenes where can you

no and jane and i don't shoot at several

is less talking with that we know

we're talking about a project actually going on how they get medical care workers to

work

and they're looking at the what is it a to actually can it's to do

is in the medical care to go to these places where

you don't really want to be you already

if you most medical workers they're actually okay well how can i try different things

are regions to say

is it a descending some people here what do we had a pretty local people

and eighty hours so they are kind of doing this

has they go because it can just right one stressed because i don't tell it's

way too early so they're trying lots of works just see how they can get

medical care people go to these different communities

and i'll try to extrapolate it can find in come up with either strategy for

analysis of five experimentation

well adequate research going on okay be behavioural economics and it is really well for

this

and i o where

so i think it kind of place out that way and o

one coming on what thirty a and so he's mentioned several things does the video

once we get the you know ready

i think is a was the emails a central derivative nike it is also on

the paper it sounds on a paper you have a very interesting yes really or

video for

usa a that is a specific content of this right

rise more looking at the programming

and now

learning implies

so other people i wanna watch that a one

yes i wasn't thinking something the estimated by adding a new blind

reappointment

i and study some fate

great success

and you like to thank and let you know but that and we can contact

somebody be

okay

sure so i mean to there is

we couple of things that

uwb i'll talk about failures for this

b i mean word incubator

of sorts we need you very social change ventures in the broadest references not all

the marketing change all but all the more target word

some kind of change that is

like all and group is what i work for even though i work for each

b

the point is a like a norm that just works with

of facilitation projects looking at building locations such

means a very is and there is a sixteen different ventures

has incubator the last few years a better of varying stages of each page

so the failure the reason i bring you know is that bees pond off

e

in ventura called fill fork

and that's actually good runs fill for

is the brains behind he'd of these filler for now and then she spun that

all other organisations do the same social google fill forward you should be able to

find a lot of resources and contact on the website

so the idea that under free resources and plus a if you like to

soc

so this is a resource that's

but on uwb side with the fill your for

i systems is at one time for it's a great

symbol to mobilise organisational culture and because it's a statement of public statement

on that allows all over staff to

you'll come from over there and have conversations feel like it feels okay to talk

about failure because when no one

for the filler for the content of the feeling for

is very fail to actually you

it's just like i read some failure for articles all read them but they come

out a but at the end of the day i and we're not gonna go

back and we

we other people's feelings from five years ago

designing a program that the breathing

b veil

however

i think the impact does have that everyone is very comfortable saying and that's

i didn't work and that at least helps on data

being flexible and adaptive and media comparable to fail so it's fifty percent

and adding right is also trying to ask himself this question is how do you

use existing information in

not repeat mistakes and you guys are all here for that reason so are we

have the same problem

well

so we got us a scale filter four

i was cancerous our four star generals there's i average everybody's

but

while a lot of a sentence i

i have anything i shall and an okay

where

well

no i create miracles for these are about as

on the end of

if you're of your

responder onset rhyme and centralized to

allow for failure which was probably are evaluation process to what we

right so the query reduction absolutely and you know it's fascinating that and we just

be personally is that i

i mean

i live in read stuff but if you but mean environment

where i need to save face i will say face and i myself but l

studio out still kinda conform to the incentives that around socks

that this distance is terrible recognition

that we're it is very susceptible

your local structure

the travesty drops

with the previous failures stars show

and next compute

he was also process but this problem

it was thinking for

i feel i and huh

and then and then every subsequent layer management does the same thing

whereas in that be okay

and one not easy and name is it's flat is that they are trying to

the learning disability so everything that described is

kind of ongoing work

i it's weird because i mean it's i do then sure it's of the whole

idea of uwb is that

if we think that something is needed in a system

and it can be done and then x

then we push it out as a as kind of but probably neutral or a

for profit entity a support group is a nonprofit consultancy and the learning all this

based and you can to

that's focused on building

learning organisations in these task so working tanzania can you going to

working with and using programs to build a sculptor

and because we're based overseas are able to run kind of

learning events practitioner learning and bring people together

put out that you

a influence pieces

and then are brand or is working programmes directly

to build but for me i work for uwb correctly

toronto canada anymore

a learning stuff in terms of

articulation packaging

but you are coming i have to be after that

i