Analysis
The Challenge
M&T Bank’s Employee Mobility service allows users to get services from their approved personal device. This allows M&T employees to be productive while on the move providing quick and easy access to email, calendar, and internal websites. With the transition to a new, mobile-friendly LMS, M&T identified a need for mobile course development.
In my data analysis, I found that 72% of employees want to receive regular feedback as reported on the performance management scorecards. In surveying the leaders, I found that 80% of them are uncomfortable providing employee feedback and 67% are not finishing the learning because they don’t want to be tied to a computer, they prefer to review the learning material while on the go. Through research, I found that a case study experiment concluded that 45% of learners completed learning faster and increased their competency score by 1.21% when given access to mobile learning (mLearning).
The Deliverable
Build a mobile-friendly template for mobile learning modules that outlines appropriate specifications, standards, and parameters for screen size, text, and images. The template will be used by instructional designers at M&T Bank to quickly create short learning modules that function on all mobile platforms and devices.
Research microlearning approaches, methods of deployment and best practices for financial institutions. Responsiveness of mobile learning solution is crucial. Develop a high-fidelity mockup of a course example that uses the template with M&T Bank content.
· Responsibilities: Instructional Design, mLearning Development
· Target Audience: Frontline managers and leaders who are in a position to influence through coaching, providing feedback, and recognition
· Tools Used: Adobe Illustrator, Articulate Rise 360
· Budget: Low
· Timeline: 1 month
· Client: M&T Bank
Considerations
Primary goal is to add reinforcement, no longer a one-time event.
· M&T instructional designers primarily use Storyline 2 currently, but consideration will be given to build a template in newer version for future use.
· With new leadership and new LMS (Workday) coming in 2019, we are open to change, i.e., alternatives to storyline for mobile course development.
· Look into responsiveness of solution. Can we build a course that dynamically plays on laptops, tablets, and phones?
· Please include a slide/section in the template that is capable of playing a video that is hosted in a video portal (e.g. Kaltura, YouTube).
· Microlearning approach (build template for short courses, not long).
Bonus:
· Develop a course example that uses the template.
· Provide us with your findings and best practices that you learned in the process
Data
After reviewing the above information, I acquired and analyzed past surveys completed by course participants. The surveys revealed that 35% of people managers are not engaged with learning; 100% of those learners said that due to their role they would be more engaged if they had access to learning on a mobile device.
Additionally, I researched mobile course development using various authoring tools. I determined that Articulate 360 should be recommended because:
- Rise received 5/5 stars for mobile capabilities, popularity, and ease of use. It is simple to use, very responsive, and allows for rapid development
- Articulate is also on the forefront of the eLearning authoring tool industry and very popular, providing a strong online support network
- The M&T Instructional Design Team is already familiar with Articulate products, so there will not be a steep learning curve
- Subscription model provides continuous updates and new features
Design
Instructional Design
First, I researched best practices for corporate leadership course delivery, including potential project outputs. For responsiveness, use standard 16:9 ratio, larger hotspot for finger taps, no hover interactions, image quality and ability to swipe through content. Additionally, the following design elements were considered:
- Self-assessments are great for bite-sized mobile learning courses
- Break up content into bite-sized chunks and design the content for easy navigation and searching
- More complicated subjects may require up to 5 minutes, while less involved concepts may only call for a 2-minute mobile learning activity
- Include visually compelling images, layouts, graphics, and colors that grab their attention and foster a positive learning environment
- Consider using the word “select” instead of “click” in text and narration
- Button size should be big enough to easily tap with a finger
- Use bullet points and minimal text
- Use 16px to 20px (12pt to 14pt) text for mobile
Next, I met with SMEs to understand the expectations and challenges for providing feedback. This helped determine the delivery methods for the final project and define business outcomes, not just learning objectives. Microlearning will allow the learners to remain engaged with their mobile learning content. I used Mayer’s 12 Principles of Multimedia Learning to ensure the course would be effective. My process included creating learning objectives and chunking learning content into meaningful groups. This reduces the amount of information held in working memory and facilitates long term memory recall. User feedback helped generate the final product.
Objectives
Finally, I developed the learning objectives for the leadership course. After analyzing the learning offering, I determined that the source of the performance issues was knowledge.
· Prepare for delivery of feedback in a way that minimizes defensiveness while promoting problem-solving and learning in 100% of employee interactions (Understanding).
· Identify opportunities to provide employees with feedback with 90% accuracy as reported on the feedback scorecard (Application, Synthesis).
· Distinguish coaching versus feedback with at least 80% accuracy identified through the final course evaluation (Understanding).
Development
I started by creating an mLearning text-based storyboard on providing feedback. This included chunking the content into mini-lessons. Then I created the lessons in Rise.
The mLearning includes a template for creating future microlearning. I walk the learner through the meaning of feedback, feedback in coaching, constructive feedback and how to deliver feedback. I focused on the POISE acronym for delivering feedback to employees. The learner completes self-assessments throughout and is provided with an infographic at the end.
Implementation
The course was implemented with the spring cohort of leaders. It was made live in the LMS to track learner analytics. Learners were able to take and complete the scenario-based eLearning successfully with 100% participation rate.
Evaluation
I used the Kirkpatrick Model Four Levels of Learning to evaluate the course. Out of 11 participants, all 11 completed the Providing Feedback mLearning course. When surveyed about the relevancy, average participant ratings were a 8.5 out of 10.
Level 1: Reaction
Learners completed a course evaluation to measure engagement, favorability, and relevancy. 80% of participants reported overall satisfaction with the content.
Level 2: Learning
Informal: Prior to modernizing the course, only 20% of learners reported confidence in delivering feedback to employees. The spring cohort had 70% report confidence when delivering feedback.
Formal: Prior to modernization, 67% of learners reported not completing the learning because of a lack of mobility. The spring cohort had 100% of learners complete the feedback session. Learners noted their openness to delivering & receiving feedback.
Level 3: Behavior
During annual performance reviews, their direct reports stated positive behavior change with only 35% of people managers scoring a 3 out of 5 or lower on their feedback scorecard as reported by direct reports. This demonstrates 37% improvement.
Level 4: Results
During the initial implementation with the 1st cohort, 100% of learners completed their learning faster and increased their competency score by 1.16% when given access to mobile learning (mLearning).
Experience the Course
Old Template
Collaborative effort with my SDSU cohort