Measuring MOOC Learner Success and Post-course Career Development

success_banner_20171123

How do you measure success? Many researchers, when evaluating Massive Open Online Courses (MOOCs), tend to measure the success of a course with a single metric, i.e. the completion rate. However, MOOCs generally have a large audience, and given the diverse background of MOOC learners, every learner differs in goals and level of engagement with the course materials. It may not be comprehensive enough to evaluate learner success by simple looking at whether he/she has finished the course; and the overall course completion rate alone may not suffice in evaluating the success of a MOOC.

This is what we learnt from a seminar entitled “Demystifying Learner Success: Before, During, and After a Massive Open Online Course”, delivered by Dr Elle Yuan Wang, a Research Scientist at EdPlus Action Lab, Arizona State University on August 1, 2017. Organized by the Faculty of Education, this seminar offered us a different perspective on how to measure success of a MOOC, an ongoing debate among researchers.

Learner Success in terms of Post-Course Career Development
Dr Wang believes that learner success can take many different forms – traditional assessment scores, or in other forms of post-course development, such as career development. In her 2014 study, she measured the post-course development of a group of MOOC learners two years after the end of the course using two metrics: whether learners (i) joined a relevant professional society; and/or (ii) submitted a paper in a relevant conference. By comparing learners’ post-course career development and in-course performance, she set out to investigate the relation between the two. The ultimate goal is to find out how career advancers differ from other learners in terms of their in-course performance.

The research targeted learners of the first iteration of The Big Data in Education MOOC, a postgraduate-level 8-week course offered on Coursera in 2013. Dr Wang was one of the teaching assistants of the course. (The subsequent iterations of the course have been offered on edX.)

The study revealed that:

  • Career advancers who joined a professional society or submitted a paper earned better scores and were more likely to complete the course than non-advancers.
  • Career advancers also demonstrated more frequent engagement with course components including course pages, lecture videos, assignment submissions, and discussion forums. For example, the page viewing activities of people who joined a professional society were much higher than non-members.
  • However, even though career advancers tended to have more post-reading actions, they were not significantly more likely to post, comment, or vote than their peers.

Significance of the Research
This study enriched our understanding of how MOOCs potentially impact learners’ career development and the possible association between student behaviors and positive developments. All these findings are crucial for educators in developing and improving their MOOCs in the future.

A Special Note of Thanks
Hereby we would like to thank Dr Wang for not only sharing with us her research endeavours and findings, but also inspiring our work in learning analytics in HKU. Our colleague, Dr Leon Lei, completed The Big Data in Education MOOC on Coursera in 2013 and is now applying principles learnt from the course in developing our own MOOCs in HKU. Thank you, Dr Wang, for inspiring us. We look forward to more opportunities to further explore learning analytics and educational data mining with fellow researchers in the future.

*Note: Dr Wang’s research was conducted in collaboration with Ryan Baker, University Pennsylvania, and Luc Paquette, University of Illinois at Urbana-Champaign. For further details, please refer to the original research paper: Wang, Y., Paquette, L., Baker, R. (2014). A longitudinal study on learner career advancement in MOOCs. Journal of Learning Analytics, 1(3), 203-206. [PDF]

Convocation Newsletter Autumn 2017

convocation_banner

We are happy to share our recent projects in the latest issue of the Convocation Newsletter! Our work would not have been possible without the support of the university, our colleagues and students. Thank you for your support all along!

convocation
convocation2
Both PDF and e-book versions are now available.

In this issue, we showcase our efforts and successes in developing

Two Years in a Row
We also made an appearance in the Convocation Newsletter Summer 2016. For the second year in a row, we proudly present the results of our endeavours in e-learning in this publication. We explored the incorporation of pioneering learning strategies, such as blended learning, flipped classrooms and gamification, as well as the positive impacts they bring to the classroom.
We experiment, innovate and inspire. We aspire to continue our catalytic role in enhancing the quality of learning and making teaching at HKU more potent.

Want to catch up on the latest e-learning trends? Follow us on Facebook, Twitter and Instagram. Don’t hesitate to contact us if you are eager to enrich learning with technology!

Welcoming Our Guests from Philippine Normal University

PNU_banner_new

It is always a pleasure to meet new friends. On November 13, 2017, we were happy to welcome delegates from Philippine Normal University (PNU), an institution specializing on teacher education. Our guests expressed strong interest in HKU’s e-learning landscape and our team’s ongoing effects in enriching teaching and learning with technology.

PNU_LR(Third from left) Professor Ricky Kwok; (Fifth from left) Dr. Marilyn Balagtas, Dean, PNU College of Flexible Learning and ePNU; (Sixth from left) Prof. Jason Orozco, Deputy Dean, PNU College of Flexible Learning and ePNU; (Fifth from right) Ms. Lovely Airein M. de Guzman, Faculty, PNU College of Flexible Learning and ePNU; (Fourth from right) Prof. Niño Naldoza, Head, School of Information and Knowledge Management.

Introducing TELI and HKU’s E-learning Landscape
Our meeting began with Professor Ricky Kwok’s introduction of TELI’s missions:

  1. Content production
  2. Research on students’ online learning behaviour: By analyzing the data, we aim to
    • facilitate our teachers to improve their teaching; and
    • benefit other institutions through publishing our research.
  3. System and application development:
    • We are constantly improving our Learning Management Systems, namely Moodle and open edX, and experimenting with different pedagogical ideas on these platforms.
    • Various apps have also been developed, including Newssary and the Prevention of Sexual Harassment (P-SHOC) app, to enrich students’ learning experience.
  4. Collaboration and outreach: To maximize our impact on teaching and learning, our team also regularly collaborate with other institutions in organizing events and conferences. One major initiative is Asian e-Table.

Following Professor Kwok’s introduction, representatives from our team showcased our projects, including the production of Small Private Online Courses (SPOCs), Massive Open Online Courses (MOOCs), flipped classrooms and data analytics.

PNU_LR-3Roundtable discussion on the e-learning landscape of HKU and PNU; and challenges in developing online learning materials.

EdTech Demo: Introducing Useful E-learning Tools to Our Fellow Educators
Since our guests are teacher educators, we introduced several e-learning tools suitable for training teachers, including Google Slides, Kahoot! and Mentimeter. All these tools are free and can be used in any educational context.

PNU_LR-2“We want to make sure every student is covered with the e-learning tools we are using. No one is left behind,” said Mr. Donn Gonda, our assistant instructional designer.

We also showcased our equipment and productions in our multimedia office.
PNU_LR-4Showing our guests around our multimedia office.

It is our team’s mission to connect with the international academic community and promote knowledge exchange. It is also our pleasure to meet with fellow educators enthusiastic about e-learning. We look forward to more opportunities to connect with institutions worldwide!

Asian e-Table 2017 – Deeper collaborations for stronger e-learning impact

On May 18-19 2017, the third annual Asian e-Table was held. We welcomed back our e-learning advocates/partners from nine universities 1 in Asia to reflect on and strive for enhancing and improving e-learning’s impact across the region. This year, we continue our exploration of collaboration opportunities, with the idea that “deeper collaboration reflects genuine friendship”.


We welcomed two new members from National Taiwan University, Prof Huang and Dr. Kung, who are associate directors of the Center for Teaching and Learning Development.

Other participants in attendance included edX Partner Manager Mr. Henry Kesner, and other local colleagues from HKU, HKUST, CUHK and PolyU.

Roundtable discussions
Reviewing our goals in Asian e-Table 2016, the co-creation of MOOCs amongst member institutions has kicked off, with collaborations between HKU and Peking University, Yonsei University. A central repository for content sharing has also been in shape.

The roundtable format led to fruitful discussions and continuation of previous conversations, with key topics such as:

  • Impact, measurement and metric of e-learning
  • Professional development for teachers in e-learning
  • Student preparedness and their digital literacies
  • Collaborations now and in the future between participating institutions
  • Identifying opportunities for future development within and amongst institutions

A student representative from Faculty of Education, Mr. Derek Wong, also attended a session to offer the student perspective on e-learning and digital literacies. While digitally “native”, students’ digital literacies in the classroom vary. Communication between teachers and students will help bridge the gaps and allow both parties to utilize technology effective in teaching and learning.

Presentations
Besides roundtable discussions, some short presentations provided more insights for members. The course instructors of two HKU MOOCs – “University Teaching” by Dr. Lily Zeng and Dr. Tracy Zou (CETL, HKU), and “Hong Kong Cinema Through A Global Lens” by Prof Gina Marchetti (Faculty of Arts, HKU), shared their experiences and challenges in the MOOC making process. Mr. Henry Kesner, Partners Manager at edX also gave an introduction of micromasters.





The participants visited a face-to-face workshop of ‘Interactive Online Learning’ on Data Analytics

After two intensive but rewarding days, between roundtable discussions, presentations, and coffee break and mealtime chats, our take-away goals and aims for this year are:

  • Establishing a framework to guide teachers in designing and delivering online/blended courses
  • Creating social media platforms for communication
  • Co-creating courses (such as MOOCs, on professional development), local meet-ups

Technology has no borders, so is education. Contact us if you are interested in developing online education in Asia with us.


The Asian e-Table 2017 is partially sponsored by the HKU Global Partnership Seed Fund


1 Kyoto University, National Taiwan University, National University of Singapore, Peking University, The Chinese University of Hong Kong, The Hong Kong Polytechnic University, The University of Hong Kong, University of Science and Technology, Yonsei University

Flipped Classroom Learning Symposium – Sharing of Pedagogies and Practices

Organised by Technology-Enriched Learning Initiative (TELI)

Flipped Classroom Learning Symposium banner

Details of the event:

Date : Dec. 6, 2017 (Wednesday)
Time : 9:30am – 1:00pm
Venue : CPD 3.28, The Jockey Club Tower, Centennial Campus, The University of Hong Kong

Abstract

Have you ever imagined a class, where students are actively engaged in exploring new ideas, investigating complicated cases, solving real-life problems, and creating new knowledge to challenge conventional thinking? We invite you to witness this vision become a reality by flipping the classroom.

In this half-day symposium, practitioners will share with you the rational, pedagogical strategies, challenges and solutions in adopting the flipped class approach. Together with award-winning teachers, innovative educators, and students who have experienced flipped classrooms, we explore the paths towards effective teaching and learning.

Registration

Enquiries should be directed to enquiry@teli.hku.hk.

Have a taste of HKU by taking a SPOC!

spoc-longbanner

Are you a prospective university student? Have you thought of what major you want to study in the future? Interest and ability are two key factors to consider in choosing your university major. Yet, how can you really visualize how classes in universities are like just by reading a bunch of colourful prospectus, giving only factual and static information of the courses?

Worry not! Our Small Private Online Courses (SPOCs) are here to give you a real taste of university courses which will help you make a better informed choice.

HKU is now providing three SPOCs taught by our very own Professors and lecturers:

Now on Offer: Critical Readings of Popular Culture

Registration
Register for this course by sending an email to liuyiqi@hku.hk telling us your English full name, school name, and school level and get a taste of your university life to-be!
The course begins in November. Registration is open until 15 November, 2017.

About the course
This four-module online course is designed to help you take a fresh, critical look at what seems familiar and ordinary. By drawing on various theories and analytical tools, you will become a sharp decoder of hidden messages in entertainment media.

Throughout this course, we will examine the following genres and topics:

  • Commercials: How do producers use film to convey the meaning they want to make?
  • Movies: What is the secret to Hollywood success?
  • TV dramas: Why are Korean TV Dramas so popular?
  • Print advertisements: Did you ever buy something because of an attractive advertisement? Why did you do that?

Assessment criteria for certificates
A Certificate of Completion will be issued upon completing the following tasks:

  1. Attempt all quizzes in the course, and get at least 60% correct.
  2. Participate in discussion forum by posting at least 1 meaningful post.
  3. Submit the final assignment.

A Certificate of Excellence will be awarded to learners who get higher than 80% correct of the quizzes, and receive a Grade A for the final assignment. More details about the final assignment will be introduced during the course.

spoc-certofcompletion

spoc-certofexcellence

Stay tuned for these upcoming SPOCs:

Everyday Computing

Are computers outsmarting human beings? This course will help you to develop a “computational” mindset to analyze and formulate solutions for problems encountered in everyday life. We will investigate into how these problems are related to the Internet and the impact of computing technologies to humankind.
ppp

Journey into Mental Ill-Health

Mental illness is often portrayed by mass media as a threat. This is hardly the complete story. With the use of experiential exercises, case studies, and film viewing, this course will guide you to understand more about mental health issues through reflecting on your daily life and learn to co-inhabit with people with mental illness.
ppp

Like our Facebook page to receive more information on The University of Hong Kong Online Learning: https://www.facebook.com/hkuonlinelearning/

Penn Dental Medicine Academic Initiative and the Influence of Technology Development in Medical Science

banner

Organised by Technology-Enriched Learning Initiative (TELI)

Details of the event:

Date : Nov. 7, 2017 (Tuesday)
Time : 3:00pm – 4:45pm
Venue : Room 321, Run Run Shaw Building
Speaker : Mr. Chia-Wei Wu, Director of Learning Sciences and Technologies, School of Dental Medicine (PDM), University of Pennsylvania

Abstract

Designing a successful and innovative initiative in the field of Learning and Development (L&D) is one of the most important projects for schools and organizations in the era of digital learning. It is imperative to create well-designed course materials and plan an engaging infrastructure to ensure an effective and evaluable learning experience. In this session, Mr. Chia-Wei Wu, the Director of Learning Sciences and Technologies at Penn Dental Medicine (PDM) will showcase PDM’s Online Learning Initiative and present how PDM’s Learning Technology Team (LTT) successfully developed and implemented blended learning solutions by utilizing cutting-edge learning technology tools. Moreover, you will learn how PDM LTT has harnesses the power of gamification, mobile learning and social learning to “flip” the classroom at the oldest IVY League dental school since 2013. Lastly, through an efficacy study, Mr. Wu will introduce the online learning methodologies both in synchronous and asynchronous learning scenarios with PDM’s current projects. Cecilia Tsang, the Education Development Manager from Apple, will introduce the current technology development in medical science and its influences. Different examples will be shared. This session will be of excellent value to instructional designer, online curriculum planner, or any e-learning developers whose professional focus is on finding the best use case for tomorrow’s learner.

About the Speaker

ChiaMr. Chia-Wei Wu
Director of Learning Sciences and Technologies
School of Dental Medicine (PDM),
University of Pennsylvania

Registration

Enquiries should be directed to enquiry@teli.hku.hk.

The man who dedicates his life to the stars

Kwok_banner_new_20171117

Professor Sun Kwok, a world-renowned astronomer, devotes his waking hours to exploring the wonders of the Universe. Why did he choose this path, and how did it work out for him? On 27th September, we visited Professor Kwok at the Laboratory for Space Research in Cyberport. In an interview with him, we got to know Professor Kwok as a scientist, an insightful educator, and an astronomy enthusiast brimming with passion.

banner

When did it all begin?
It was not Professor Kwok’s childhood dream to become an astronomer. Instead, when he was studying engineering at university in Canada, one day, as he read Frontiers of Astronomy by Fred Hoyle, he found out that astronomy has much to do with physics, chemistry and biology. He realized that science are tools enabling him to understand the patterns and motions of stars, and the fascinating unknown of their composition, structure and evolution. The idea of investigating the Universe with physics was exciting, and he was inspired to pursue astronomy, eventually making important discoveries and leaving a legacy.

banner

Curiosity and hard work paid off
For Professor Kwok, the Universe is still full of mysteries awaiting him to unveil. Despite hurdles, his curiosity and desire to solve mysteries drive him forward and help him overcome difficulties. Professor Kwok also adds it is all down to diligent preparation and effort, as one would never know when that eureka moment happens. His formula to reaching his goals is constant work, determination and hard work; not so much about natural talent or luck.

His efforts paid off. After countless ventures into deep space through telescopes, Professor Kwok is now the proud discoverer of many nebulae and stars. When asked how does he name his discoveries, Professor Kwok said, “it’s usually because of what they look like. In the case of cotton candy (nebula), it’s because of its shape!”

Places for stargazing
Professor Kwok has made a lot of professional observations on Hawaii’s Mauna Kea. The telescopes on its summit stand 4200 metres above sea level, where the skies are clear and the clouds are well below the observer. It is the location that Professor Kwok considers his favourite to observe celestial wonders.

But is Hawaii the only good place to go stargazing? Many often complain that it is difficult to see stars in Hong Kong due to severe light pollution. Professor Kwok remarks that even in Hong Kong it is not impossible to see, but people just turn a blind eye to them. In fact, Professor Kwok adds, it is extremely easy to see a planet even in Hong Kong, and people are always bewildered when he points to Venus at twilight. Professor Kwok suggests us all to go to the countryside, far away from the city lights, and marvel at the gifts of nature to rekindle our interest for our environment, because “it is all what our ancestors did. Everyone should see the Milky Way once in their lifetime.”

banner

The next adventure
An inquisitive mind enabled ancient people to develop science and make technological advancements. Where is Professor Kwok’s curiosity leading him next? Currently, Professor Kwok works on astrobiology and is studying organic matter in space. He also believes that the integration of different fields of knowledge, such as chemistry, biology and geology, will create a multi-disciplinary perspective and be the future of astronomy.

Professor Kwok always encourages young people to pursue their dreams. “Because at the end, it is your life, and you have to have a career that is fulfilling”.

banner

Professor Kwok was featured in the 5th episode of RTHK’s series Our Scientists. It explores Professor Kwok’s journey in becoming an astronomer, his visions in education, as well as his recent research in organic matter in space.

Follow Our Place in the Universe’s Facebook page for video clips of our interview with Professor Kwok and other astronomical facts and interesting articles!

A new tool in teaching: the Learning Glass

ppp

We are surrounded by promises about a technology-enriched learning environment – for example, how online education will supplement face-to-face lectures, how artificial intelligence will provide round-the-clock assistance to students who always work until the small hours. These promises are motivating some of our teachers to bring more innovations to their classrooms. Dr. Rachel Lui, who gave a sharing session last week, is one of them.

Thanks to the Teaching Exchange Fellowship Scheme (TEFS), Rachel was able to visit the University of California, Los Angeles (UCLA) in the summer of 2017 to investigate a new “medium of instruction” – the “Learning Glass”. The tool is a video recording system with a transparent glass board in front of the camera. This allows teachers to maintain natural eye contact with the viewers while presenting the content. The purpose is to engage students in a constructivist process of learning. Rachel’s sharing covered the following topics:

  • what “Learning Glass” is, and how to set it up;
  • why natural eye contact is important;
  • showing the thinking process in science education;
  • how “Learning Glass” is different from PowerPoint; and
  • whether we should invest in tools like the “Learning Glass”.

As a result of her trip, Rachel produced 47 videos for SCNC1111 which are in use from this semester. Here are two samples (click on the image to access the original video):
banner
banner

The informal conversations after the sharing were equally fruitful. “It was really encouraging to see that many teachers care about their courses, and are actively updating their pedagogies,” Rachel said in delight. “Some of them would like to know more about the software that I used, and some were hoping to get to know more about what can be done in the face-to-face classes after lectures are moved online.”

Rachel’s work is one example of what is possible in video lectures. As a next step, she will investigate further how to transform the entire course experience.

TEFS aims to enhance the scholarship of teaching and learning at the university through sharing of excellent pedagogical practices between HKU and other prestigious higher education institutions. Full details of TEFS can be found at http://intraweb.hku.hk/reserved_2/cdqa/doc/TEFS/TEFS_2017-18.pdf.

Our Place in the Universe Book Launch Party

Our Place in the Universe Book Launch Party

Our Place in the Universe Book Launch Party

On 27th September, students, faculty staff, science and astronomy enthusiasts gathered at Professor Sun Kwok’s book launch party hosted by the Common Core Office to congratulate Professor Kwok’s release of the new edition of Our Place in the Universe. Professor Sun Kwok is a reowned astronomer who has made many important astronomical discoveries, particularly on nebulae, and is the former Dean of the Faculty of Science and Chair Professor of Physics.

Our Place in the Universe Book Launch Party

What is this book about?
Professor Kwok explains that this book is not about technical knowledge on astronomy and physics. Rather, by following the footprints of 5000 years of astronomical development, it shows the evolution of humans’ way of thinking – demonstrating how humans developed rational thinking through their observations and understanding of the universe. Our Place in the Universe takes us on a journey, studying how the development and advancement in science continuously change humans’ perception of self and the world.

Our Place in the Universe Book Launch Party

What other things do we learn about Professor Kwok?
At the book launch party, Professor Kwok shared his ideas on astronomy as an oldest and newest science, interesting bits of his journey of becoming an astronomer, thoughts on the future of science, and many more. To have a glimpse of the interesting questions raised by the audience, click on the link below:

Question: Do you think our current understanding of the Earth and the universe is correct?

Want to find out Professor Kwok’s answers to the audience’s other questions? Follow our facebook page for updates! https://www.facebook.com/ccst9012/

Our place in the universe is available on Amazon. Check it out at https://www.amazon.com/Our-Place-Universe-Understanding-Fundamental/dp/3319541714