We know what you’re thinking: does the world really need another stand-alone, virtual calculator? Well, let us stop you right there because that is not what Benetech’s Math Editor is. Much more than a calculator, it’s an accessible way to show your work. If you have ever worked with students who have had trouble in math because they have a visual disability, a cognitive disability, a physical disability that makes using pen and paper impossible, or even just illegible handwriting, then you’ll want to check out this tool that lets students show their work digitally.
In response to community feedback urging for tools for editing digital math, the DIAGRAM Center, with the help of Dr. Neil Soiffer, is developing an accessible math editor that makes it easier for students with disabilities to do math online. Showing and communicating one’s work online (a Common Core criteria) is challenging for students and educators and especially difficult for students with disabilities. When the DIAGRAM team began reviewing digital math education tools, we were disheartened to learn that none of the 70+ tools we investigated had three educational features that are critical to digital math education:
- Inclusive tool that all learners, with and without disabilities, can use, with accessibility
features for learners requiring different input and output modes;
- Enabling students to show work and demonstrate comprehension, particularly important as Common Core standards require students not only to do the math, but also to explain how they do it;
- Ability to manually manipulate equations by moving or crossing out
components, without having the platform simplify the math automatically.
While tools like digital scratchpads for math are often available on the online platform, they are typically inaccessible for many students with disabilities, such as visual impairments, learning, or motor disabilities; they also tend to be incompatible with assistive technologies. Our early classroom observations uncovered huge gaps in existing tools that support students doing math online and allow students to communicate their work to their teachers. As a result, we wanted to provide alternatives for students with physical disabilities or issues with fine motor skills that would allow them to explain math problems verbally. For students with intellectual disabilities, we wanted to reduce the cognitive load of complex math problems by allowing students to review their work step by step. And for students with visual disabilities, we wanted to make sure there was adequate screen reader and braille compatibility so that students could work independently.
While learners were the primary target users of Benetech’s Math Editor, our early user feedback tests revealed that such a tool can also provide huge benefits to teachers. By keeping a true history log of each student’s work with user explanations attached, educators are provided more information to accurately assess the level and needs of each individual learner. Furthermore, a platform that records a student’s steps and explanations throughout the problem-solving process minimizes the amount of one-on-one time required by educators to grasp the thought process of a particular student.
Last month, the DIAGRAM Center and Dr. Soiffer completed the initial prototype of the Benetech Math Editor. While still in the alpha stage, we are incredibly excited about the potential for this tool both with students who have disabilities and for students in mainstream classrooms. A seventh-grade math teacher told us: “It makes me so happy to see all the academic vocabulary being used in their explanations, and actually being able to read their thoughts as they work through the problems! You all really thought through this problem and came up with a great solution.”
Students also responded favorably. In our most recent round of testing, four out of five students preferred the math editor over using pencil and paper (which, until trying Math Editor, was their first choice). “This tool gives me the ability to review my work and steps before submitting it to my teacher; it also helps me break the problem down into smaller steps.” said one student. Another student was thrilled because “it helps people with messy handwriting – now my teacher doesn’t have to guess what I wrote.”
We’re excited to receive such positive feedback so early on in the project and look forward to receiving more feedback from students and educators representing various disabilities. If you or a student you know are interested in being a tester, please contact Sue-Ann (firstname.lastname@example.org).
My name is Charles LaPierre, and I am the Technical Lead for DIAGRAM and the Born Accessible Initiative. Last month, my colleague Deanna McCusker, who is the head of user experience at Benetech, and I attended the Bay Area Accessibility Camp. Three concurrent tracks focused on testing and standards, accessible user interfaces, and accessibility for those with cognitive disabilities. I attended a session on interactive maps and how to make them accessible which is what we have been working on with our data visualization task force. I then enjoyed the session on “Virtual and Augmented Reality Uses and Challenges for People with Disabilities” by Christopher Patnoe from Google. Christopher demonstrated some virtual and augmented reality and discussed the concerns and issues around accessibility, but there were no clear takeaways. Instead, it was more of a discussion around the current state of this new technology and what we need to be thinking of as it matures. The highlight of the event was a session called “Designing for People with Cognitive Limitations” by our very own DIAGRAM Community member Dr. Clayton Lewis. Clayton stressed the importance of collaborating with people with cognitive limitations, their families, and caregivers throughout design and development can lead to more cognitively accessible software. Retrofitting a product to make it accessible or only thinking about accessibility at the end of a design cycle will seriously limit the usefulness of the software, especially in the case of cognitive accessibility, as this may not be possible at or near the end of the development cycle. I couldn’t agree more as this is the main rationale for Benetech’s Born Accessible initiative.
It is a thrilling time in the standards world with the publishing industry having great momentum toward adding extended descriptions to images. Of course, with great momentum comes rapidly changing practices, and we want to make sure that the relevant recommendations are being updated consistently to reflect what is supported by the current state of both the standards and the different reading systems.
As part of this effort, the Standards Working Group has been reviewing recommendations for how to mark up extended descriptions for the Web as well as inside an EPUB. We have nine separate tests based on using ARIA details, a future ARIA 1.1 specification. We have created an EPUB with various options and will be testing these to see how each performs with various screen readers and reading systems. In the meantime, we are also looking into updated alternatives that we can recommend immediately to publishers as they add extended descriptions to their EPUB books. Also on our radar is the need for standards around digital publishing such as media overlay support. Just this month, many of the working group’s members attended the annual TPAC meeting where they met with a number of W3C working group members to discuss exactly what future standards are needed for this quickly expanding area.
Supporting math in EPUB is an ongoing challenge and one that continues to impact students with disabilities who are forced to rely on specialized systems to interact with math in even the most basic ways. Figuring out how to get browsers to support math would eliminate the need for students to have external support and allow them to have a much more meaningful experience with math and math-related subjects. The Math in EPUB Task Force is determined to make this a reality. The group recently met with Microsoft’s Edge Accessibility Team to discuss MathML support in the Edge browser. The group shared its findings regarding digital math and asked to have the raw MathML exposed to AT in Edge so that it can be made accessible. They were receptive to the suggestions and the group hopes to have updates soon.
The group has also been working with Apple to resolve some MacOS/iOS issues with our current solution of having MathML hidden offscreen with either an image/HTML or CSS fallback of the math. We have also created three sample EPUB books with this solution and have started testing it. Unfortunately, recent tests on some reading systems have exposed a few problems, but the group is already looking into ways to solve these issues.
The Accessible Data Visualization Task Force has been identifying state-of-the-art examples of data visualizations and indicating if these are open source or proprietary solutions. We will continue to document what is currently available and provide examples and techniques to the DIAGRAM repository of accessible widgets/tools and ultimately provide guidelines on how to do accessible data visualizations. There may also be opportunities to discuss our ideas for future work in ARIA.
The Drag and Drop Task Force has refined its analysis of the different applications of the drag-and-drop metaphor that give rise to distinct accessibility issues. This work has been facilitated by the identification of examples of each case arising in educational applications (especially interactive simulations). The findings of the task force’s analysis of these access challenges, and how they can be addressed, will be shared with the DIAGRAM community when the documentation is ready for wider review. This work will serve as the basis for authoring guidelines for developers of interactive educational applications that employ drag and drop in their designs.
Here is a list of recent and upcoming places the DIAGRAM team and DIAGRAM community members have attended or presented at. Do you have an upcoming engagement you’d like to share? Let us know and we will include it. info[at]diagramcenter[dot]org.
- Bay Area Accessibility Camp (October 21, San Francisco, CA)
Accessibility Camp Bay Area is a participant-driven event, where participants help shape the schedule by suggesting topics of interest when they register. These topics range from focusing on users with different disabilities, sessions on digital accessibility topics from the web (technical to tactical), desktop software, mobile apps, eLearning, online gaming, open source innovations, and everything in between. This year Deanna McCusker, head of user experience at Benetech, and Charles LaPierre, DIAGRAM technical lead, both attended, along with numerous other DIAGRAM community members. Read a write up of Charles’ experience here.
- DAISY Board Meeting (October 24–26, Baltimore, MD)
Members of DIAGRAM and the Benetech team presented Benetech’s work on the Global Certified Accessible initiative.
ITC Conference (October 27th, Washington DC)
The ITC Conference is a two-day symposium with a heavy focus on accessibility testing, automated and manual testing, and WCAG 2.1. George Kerscher and Charles LaPierre presented “Accessibility Standards Around EPUB,” Benetech’s pilot program for certification and Benetech’s Global Certified Accessible initiative.
- TPAC Technical Plenary / Advisory Committee (November 6-8, Burlingame, CA)
This huge meeting brings together W3C technical groups, the Advisory Board, the TAG, and the Advisory Committee for an exciting week of coordinated work, face-to-face meetings and discussions. This meeting is widely attended by DIAGRAM staff members and community members. The DIAGRAM Center hosted a happy hour for meeting participants, the DIAGRAM community and the DIAGRAM team. The energy was high and it was a lovely way to kick off TPAC and a week of publishing Working Group meetings and joint meetings with CSS, HTML, and APA (Accessible Platforms Architecture).
- Publishing Summit (November 9 -10, Burlingame, CA)
The publishing summit was a great opportunity for DIAGRAM to further explore personalization and showcase our Born Accessible work. Charles LaPierre met with the ARIA Working Group to discuss setting up a new framework to semantically mark up content to make it more accessible by personalizing the content to suit the users’ needs. George Kerscher presented on accessibility standards in publishing and showcased the ACE tool for automatically checking EPUBs for accessibility.
- Webinar on the First Annual DIAGRAM Report (November 13)
Hosted by the DIAGRAM Center, DIAGRAM report writers Lisa Wadors, Senior Program Manager: Education, Research and Partnerships, and Charles LaPierre presented on the six new technologies the report focused on, the opportunities discovered, the challenges uncovered, and the key takeaways. Don’t worry if missed the live webinar. A closed-captioned recording of the webinar will be made available on our website in the coming weeks.
- Webinar: Guidelines for Creating Accessible Ebooks, (December 5)
Charles LaPierre will be presenting for the Access for All Challenge.
- Webinar: Born Accessible Certification, (Dec 14)
Robin Seaman and Charles LaPierre will present on Benetech’s Born Accessible Certification work at this free DIAGRAM-hosted webinar. We will post more details about the webinar along with registration information soon.
Name: The First Annual DIAGRAM Report
Date: Monday, November 13, 2017
Time: 12 PM – 1 PM Pacific Time
Join us Monday, November 13th for a free webinar on one of DIAGRAM’s newest resources, the DIAGRAM Report. The report explores six technologies that have the potential to significantly impact the learning landscape for students with disabilities. Report authors, Charles LaPierre and Lisa Wadors will be discussing the technologies they focused on, the challenges they found, the opportunities they uncovered and of course their key takeaways. Time permitting, they will also engage participants in a discussion on potential new technologies that should be explored in the 2018 report. You won’t want to miss it!
- Eclipse Soundscapes is an App that was designed to allow people to experience the 2017 Solar eclipse by touch and sound and incorporates and uses imagery description techniques developed by DIAGRAM community partner, NCAM.
- Museum makes exhibits accessible for autistic kids is an article posted on the Winnipeg Free Press website about how the Children’s Museum of Manitoba is broadening their accessibility efforts.
- Accessibility and communication apps take FCC honors is a TechCrunch article highlighting for Apps that the FCC recently honored for creating tech that helps people with disabilities take advantage of the internet with greater ease.
- 3D-printed Nintendo Switch peripheral is huge for gaming accessibility is a short article on Mashable about one way 3D printing technology is making video games more accessible.
After much anticipation, our revamped Poet Training Tool is now available! In recent months, we have received invaluable feedback from countless members of the DIAGRAM Center community. For those of you who might be less familiar with it, Poet was originally designed as a mechanism that enabled volunteers to provide crowd-sourced image descriptions for critical diagrams found in educational texts. We know that getting image descriptions in text books is critical to a born accessible work flow. But to really drive more accessible content for students with disabilities, we needed to provide publishers and other content creators with the right tools to make born accessible books a reality. After running numerous image slams we realized what they really needed was technology for better, scalable training for writing descriptions. So we are thrilled to be unveiling Poet like you’ve never experienced it before, a training tool to provide users with interactive exercises to determine “when to describe” and “how to describe” images, as well as an opportunity to apply these guidelines and “practice describing” their own content.
Please take our new training tool out for a spin and/or help to share this resource with the community of practitioners. There are Provide Feedback links sprinkled throughout the site to share thoughts about this new tool. And stay tuned for additional features to be added in the coming months and stories from publishers about how Poet is making a difference!
As if there weren’t already enough reasons to be impressed with DIAGRAM community member and Co-PI George Kerscher, here’s one more. George, Gail, and Kroner recently participated in the 2017 Missoula Half Marathon which is 13.1 miles (21 km). Gail, George’s wife, ran it, finishing with a time of 2 hours and thirty-six minutes. George and his guide-dog Kroner walked it finishing in four hours and thirteen minutes. Needless to say, we’re all pretty impressed. Congratulations George, what an accomplishment!
One: Standards Working Group Update
By George Kerscher
Extended descriptions are near and dear to the hearts of the DIAGRAM community and we (the DIAGRAM Standards Working group) have made advances on the extended descriptions front. Currently, in Aria 1.1, which is also expected to become a W3C recommendation early in 2018, we have an attribute called “aria-details.” This attribute can take an ID of an element on the page and provide the mechanism to associate the extended description of the image, figure, or any other HTML element. We envision this to be used in combination with the HTML “details” element. We have developed a series of examples that demonstrate the usage, and while the examples are not polished, you can still get a good idea of where we are headed by visiting: https://rawgit.com/daisy/aria-details/master/index.html
We’re also continuing to develop recommendations for math in EPUB and on the web. Stay tuned for a list of examples.
Two: Developers Working Group Update
By Charles LaPierre
During the DIAGRAM Strategic Planning meeting, the Working Group decided to have bi-monthly meetings to keep the momentum going. We currently have two task forces under the Developers Working group, Drag and Drop and MathML in EPUB. Now that those are both going strong, we will kick off an additional two more Task Forces that fall under the Developers Working Group’s domain. The first has been named “Thinking Outside the Box” and will help with identifying as many areas as possible that currently limit access to educational materials for students with a variety of disabilities. Identification will focus on disabilities not traditionally associated with print disabilities such as cognitive and physical impairments. The second task force is to make data visualizations accessible and fits in with our commitment to exploring the application of new markup languages for accessible STEM content such as ChartML and ChemML. As always, if any of this work sounds like something you would like to participate in, we welcome new members. Feel free to email Charles for more information on joining.
Three: Data Visualization Task Force Update
By Charles LaPierre
The DIAGRAM Center is creating a new Task Force under our DIAGRAM Standards Working Group called “Data Visualization Task Force.” Our goal is to find common ground on how we can make an open standard and/or best practices around accessible data visualization. The Task Force will meet once a month or every other month depending on the group’s availability and time constraints. If this sounds like work you would be interested in participating in, please fill out this Doodle poll which will help us schedule the first meeting. We are very excited about the potential for this group and where the work will take us.
Four: Content Working Group Update
By Amaya Webster
The big news for the Content Working Group is the finalization of the updated charter. The key mission of the charter is to connect with the other working groups to make sure the work they are doing is made available through real world examples with instructions on how to implement it. The Content Working Group will also work on building out Imageshare, test 3D content delivery with gh, explore visual storytelling tools with Gallaudet and produce at least one example and/or resource around accessible audio-visual content with closed captioning and audio descriptions for video. The group is also in the process of forming two sub-groups, one to further explore ways in which interactive materials can be made accessible and another to delve into the accessibility needs of people who are Deaf and hard of hearing as well as ways to increase visual literacy. If the work of this group is something you would like to be involved with, new members are always welcome. Contact Amaya for more information.