This document provides a tool for real-time evaluation of a Ushahidi/Crowdmap platform implementation. It asks the user to evaluate whether the project is meeting its goals and objectives. It then prompts the user to identify which parts of the project are working well and need improvement in order to achieve the objectives. Finally, it guides the user to develop an action plan based on the findings of the evaluation to improve the project.
2. So
you’ve
done
all
of
the
planning
to
implement
your
Ushahidi/Crowdmap
pla?orm.
We’re
here
to
help
you
self-‐evaluate
how
it’s
working!
Video
Audio
Image
Text
TWO
WAYS
TO
USE
THIS
TOOLBOX
1) The
project
is
happening
now….I’m
ready
to
learn
about
how
the
project
is
✔
A
doing
to
make
immediate
changes
to
improve
the
project!
2) Well…
My
project
is
over,
but
I
want
to
learn
about
the
successes
and
✔
B
challenges!
3. The
first
step
is
to
ask
the
following
big
ques-ons….
• Is
the
project
fulfilling
its
goals?
Video
Audio
Image
• Is
the
project
fulfilling
its
objec-ves?
Text
4. Video
Answer
the
following
big
ques-ons….
Audio
Image
Text
Goals:
Do
you
agree
or
disagree
with
the
following
statement?
The
project
has
:
“Goals
from
implementa5on
toolbox,
panel
#4,
imported
here”
Strongly
disagree
undecided
agree
strongly
disagree
Agree
Why?
more
goals….
Objec<ves:
Do
you
agree
or
disagree
with
the
following
statement?
The
project
has
:
“Objec5ves
from
implementa5on
toolbox,
panel
#4,
imported
here”
Strongly
disagree
undecided
agree
strongly
disagree
Agree
Why?
More
objec-ves….
5. Video
How
are
you
achieving
your
Audio
program
objec-ves?
Image
Text
Which
parts
of
your
project
is
working
well?
and
helping
to
achieve
your
objec-ves?
Partnerships
Communica-on
Technology
Maps/Visualiza-on
Campaign/Messaging
Informa-on
Security
Informa-on
Flows
Volunteers/Teams
Ac-on/Feedback
Other,
please
describe______
Which
parts
of
the
project
need
improvement
and
may
be
preven-ng
the
project
from
achieving
its
objec-ves
Partnerships
Communica-on
Technology
Maps/Visualiza-on
Campaign/Messaging
Informa-on
Security
Informa-on
Flows
Volunteers/Teams
Ac-on/Feedback
Other,
please
describe______
User
ac5ons:
A)
select
2
from
“working
well”
and
2
from
“needs
improvement.
B)
select
all
that
apply
6. So
now
you’ve
learned
from
&
Video
Audio
evaluated
your
project
…What
Image
are
your
ac-on
plans
for
change?
Text
Some
way
to
auto-‐import
the
selected
categories
on
slide
6.
Here
is
a
RTE
example
Findings
Ac<on
Plan
Check-‐in
(EXAMPLE)
Partnerships-‐
We
have
a
strong
(write
your
ac5on
plan
here
)
We
will
con5nue
to
have
monthly
(when
will
you
rela-onships
with
our
community
partners,
mee5ngs,
and
will
look
for
people
to
support
the
workshop
space
to
check
in
to
see
we
trust
each
other.
We
have
monthly
help
con5nue
to
bring
people
together.
how
you’re
mee-ngs
to
keep
our
rela-onship
strong.
doing
with
your
(SUCCESS!)
ac-on
plan?)
(EXAMPLE)
Informa-on
Security-‐
our
informa-on
security
plan
is
working,
Our
servers
are
secure
and
there
is
a
con-ngency
plan.
Our
partners
provide
monthly
feedback
about
their
concerns.
There
has
been
no
security
events
yet.
(SUCCESS)
(EXAMPLE)
Volunteers-‐
It
has
been
hard
to
keep
our
volunteers.
They
say
the
long
hours
and
travel
are
difficult.
It
is
difficult
for
Print
your
ac-on
plan
the
project
manager
to
train
each
new
now!….
volunteer
every
day.
(CHALLENGE)
7. Print
out
your
Evalua-on
Here
are
the
different
parts
of
your
evalua-on
(you
can
click
on
each
one
to
print
specific
sec5ons)
–
(autofill
in
base
on
what
is
check
on
slide
5)
–
(autofill
in
base
on
what
is
check
on
slide
5)
–
(autofill
in
base
on
what
is
check
on
slide
5)
–
(autofill
in
base
on
what
is
check
on
slide
5)
–
(autofill
in
base
on
what
is
check
on
slide
5)
–
(autofill
in
base
on
what
is
check
on
slide
5)
Print
your
self-‐
• Print
all
of
your
checklists
and
ac-on
plan
evalua-on
report
here….
8. Video
Audio
Partnerships
Checklist
Image
Text
1.
Which
partnerships
in
your
project
are
working
well?
Why?
2.
Which
partnerships
in
your
projects
are
difficult?
Why?
3.
Is
there
trust
between
your
partnerships?
Why
or
why
not?
4.
If
your
audience
include
local
communi-es
are
they
also
your
partners?
How
is
it
going?
9. Video
Audio
Technology
Checklist
Image
Text
1.
How
is
the
technology
support
(
example,
server
support,
PHP
support,
***)?
What
are
the
challenges?
2.
Do
you
feel
your
partners,
volunteers,
and
audience
are
comfortable
with
the
technology?
(SMS,
ushahidi
instance/crowdmap,
etc,
viewing
the
map)
3.
Are
your
volunteer
or
teams
who
are
responsible
to
processing
messages,
reports,
comfortable
with
the
technology?
What
are
the
challenges?
10. Video
Campaign/Messaging
Checklist
Audio
Image
Text
1.
Do
you
believe
that
your
audience
(or
crowd)
understand
the
purpose
of
sending
in
informa-on?
Why
or
Why
not.
2.
Do
you
believe
that
your
audience
understands
what
you
are
doing
with
the
informa-on?
And
how
they
will
be
able
to
see
the
results?
3.
Are
the
expecta-ons
of
your
audience
the
same
as
your
expecta-ons?
Why
or
Why
not?
4.
What
needs
to
con-nue…..
to
keep
your
messaging/campaign
successful
and
sustainable?
to
improve
your
campaign
strategy.
11. Video
Audio
Informa-on
Flows
Checklist
Image
Text
1.
Are
you
collec-ng
the
type
of
informa-on
you
planned
on?
Is
it
helping
you
achieve
your
goals
and
objec-ves?
How?
How
not?
2.
How
are
you
analyzing
informa-on
(
verifying,
confirming,
mapping)
What
is
working
well
and
what
can
be
improved?
3.
Do
you
feel
now
that
your
categories
are
appropriate,
why
or
why
not?
3.
Click
here
to
evaluate
and
revise
(
or
re-‐evaluate)
your
informa-on
flow
diagram
12. Video
Ac-on/Response/Feedback
Audio
Image
Checklist
Text
1.
Is
the
informa-on
collected
being
used
in
the
way
you
planned?
2.
Have
you
been
communica-ng
back
to
your
target
audience/or
the
public?
3.
How
well
do
you
and
your
partners
feel
the
report
and
maps
are
returning
to
decision
makers
for
program
change?
4.
If
it
has
been
more
difficult
than
you
thought
to
share
informa-on
and
the
maps
with
your
par-cipants
and
audience,
why
do
you
think
this
is
happening?
5.
Click
here
to
see
your
informa-on
flow
and
feedback
diagram,
what
would
you
keep
the
same
and
what
would
you
do
differently?
13. Video
Audio
Communica-ons
Checklist
Image
Text
1.
Are
your
par-cipants/crowd
communica-ng/sending
you
informa-on
in
ways
that
you
thought?
Why
or
why
not?
2.
What
part
of
these
communica-on
successes
are
due
to
technology?
3.
What
part
of
these
communica-on
successes
are
due
to
trust,
other
reasons?
14. Video
Audio
Maps/Visualiza-on
Checklist
Image
Text
1.
What
do
the
dots
on
the
map
mean
to
your
project?
To
your
par-cipants?
To
Others?
2.
Are
people
specifically
using
the
map
for
decision
making
and
ac-on?
How
are
they
using
it?
If
they
are
not,
what
are
they
telling
you
as
the
reasons
why
they
are
not
using
it?
3.
How
do
all
of
your
audiences
have
access
to
the
map?
Do
they
know
the
way
to
find
needed
informa-on
on
the
map?
If
they
can’t
or
have
difficulty,
why?
How
have
they
told
you
ways
to
improved
the
access
and
find
informa-on
on
the
map?
15. Video
Informa-on,
Privacy
and
Audio
Security
Checklist
Image
Text
1.
Do
you
have
a
current
program
strategy
for
privacy
and
security?
If
so
what
is
working
well,
what
will
need
improvements?
If
not
write
here
what
your
strategy
will
be.
2.
How
is
your
project
managing
the
risks
of
sharing
informa-on
(including
the
maps)?
3.
Ask
all
of
your
partners
and
contact
your
par-cipants
to
ask
them
if
they
feel
secure
providing
informa-on.
List
the
answers
here.
3.
If
your
partners
and
par-cipants
tell
you
they
are
worried
about
privacy
what
are
their
recommenda-ons
on
improving?
16. Video
Audio
Teams/Volunteer
Checklist
Image
Text
1.
2.
3.
17. Video
Audio
(Create
your
own)
Checklist
Image
Text
1.
2.
3.
4.
5.
6.
18. THANK YOU FOR COMPLETING TOOLBOX #3!
Please save this file and add your name to the title, then return it to
support@ushahidi.com or wiki.ushahidi.com
You will receive a report from Toolbox #3 to use in your project.
In your email please send comments on how you
would like this tool improved or changed!
Thank you for being a very important part of Ushahidi’s User community!