Facebook programs computers to describe photos for the blind

FILE – This Feb. 19, 2014, file photo shows the Facebook app icon on an iPhone in New York. A feature rolling out Tuesday, April 5, 2016, on Facebook’s iPhone app interprets what’s in a photo using a form of artificial intelligence to recognize faces and objects for blind and visually impaired people as they scroll through the pictures posted on the world’s largest online social network (AP Photo/Karly Domb Sadof, File)Less

MENLO PARK, Calif. (AP) — Facebook is training its computers to become seeing-eye guides for blind and visually impaired people as they scroll through the pictures posted on the world’s largest online social network.

The feature rolling out Tuesday on Facebook’s iPhone and iPad apps interprets what’s in a picture using a form of artificial intelligence that recognizes faces and objects. VoiceOver, a screen reader built into the software powering the iPhone and iPad, must be turned on for Facebook’s photo descriptions to be read. For now, the feature will only be available in English.

Until now, people relying on screen readers on Facebook would only hear that a person had shared a photo without any elaboration.

The photo descriptions initially will be confined to a vocabulary of 100 words in a restriction that will prevent the computer from providing a lot of details. For instance, the automated voice may only tell a user that a photo features three people smiling outdoors without adding that the trio also has drinks in their hands. Or it may say the photo is of pizza without adding that there’s pepperoni and olives on top of it.

Facebook is being careful with the technology, called “automatic alternative text,” in an attempt to avoid making a mistake that offends its audience. Google learned the risks of automation last year when an image recognition feature in its Photos app labeled a black couple as gorillas, prompting the company to issue an apology.

Eventually, though, Facebook hopes to refine the technology so it provides more precise descriptions and even answers questions that a user might pose about a picture.

The vocabulary of Facebook’s photo-recognition program includes “car,” ”sky,” ”dessert,” ”baby,” ”shoes,” and, of course, “selfie.”

Facebook also plans to turn on the technology for its Android app and make it available through Web browsers visiting its site.

The Menlo Park, California, company is trying to ensure the world’s nearly 300 million blind and visually impaired people remain interested in its social network as a steadily increasing number of photos appear on its service. On an average day, Facebook says more than 2 billion photos are posted on its social network and other apps that it owns, a list that includes Messenger, Instagram and WhatsApp.

In a Tuesday post, Facebook CEO Mark Zuckerberg hailed the photo description tool as “an important step towards making sure everyone has equal access to information and is included in the conversation.”

___

Online:

Facebook’s post: https://newsroom.fb.com/news/2016/04/using-artificial-intelligence-to-help-blind-people-see-facebook

How to use iOS 8 Continuity between your iPhone & iPad for calls,texts, apps & more

Wen  you updated to iOS 8, recent iPhones and iPads will play nicely with each other, allowing users to do new functions like answering a phone call or sending an SMS message via their iPhone without having to put down their iPad, or start an email on one device before finishing it on the other.  

Please note that some devices are having issues using the Continuity feature.  

Apple has dubbed this seamless integration “Continuity,” and some of it works immediately once all of a user’s devices are updated to iOS 8. For example, if a user has the same Apple ID and associated phone number enabled on their iPad, calls will show up on the tablet once the iPhone begins ringing.

Answering a call on an iPad automatically places the conversation in speakerphone, allowing the iPad’s microphone and speakers to handle the call. Continuity requires an iPhone 5 or later, fourth-generation iPad or newer, iPad mini, or fifth-generation iPod touch.

iOS 8 also allows users to automatically enable Personal Hotspot from a nearby iPhone, in a feature Apple calls “Instant Hotspot.” A Continuity-capable iPhone will appear under the Wi-Fi section of the Settings app on iPad, and selecting that device will switch Personal Hotspot on, allowing a user to access mobile data from their cellular provider when possible. 

The iPad also gains the ability with iOS 8 to send traditional SMS text messages via a connected iPhone. Previously, users could only said iMessages to Apple devices. While SMS messaging was available to test in iOS 8 beta releases, it is not included in the final release, and Apple has said it will become active in October.

All of this same functionality will be coming to newer Bluetooth Low Energy capable Macs later this year with the launch of OS X Yosemite, which will also be a free update.

Additional Continuity features in iOS 8 are available by enabling the “Handoff” feature. Users can do this by opening the Settings application, choosing General, and then selecting “Handoff & Suggested Apps.”

“Handoff lets you start something on one device and instantly pick it up on other devices using your iCloud account,” Apple’s description reads. “The app you need appears in the lock screen, app switcher, and the dock on a Mac.”

For example, if a user is reading a website on their iPhone running iOS 8, they can quickly switch to their iPad by swiping up from the small Safari icon that is displayed in the lower right corner. Doing so will immediately open the same website on the iPad.

In addition to Safari, this functionality works immediately with Mail, Pages, Numbers, Keynote, Maps, Messages, Reminders, Calendar, and Contacts. Developers will be able to add Handoff into their own third-party apps as well.

The “Suggested Apps” function also utilizes a user’s location to recommend applications. For example, if a user is at a Best Buy retail store, iOS 8 will display an App Store icon in the lower left corner of their iPhone lock screen. Swiping up will take the user to the App Store listing for the official Best Buy app.

If the Best Buy application is already installed, the icon for it will be displayed in the lower left corner, giving the user quick access to the app while they are in the store. This will help expand iBeacon functionality, which requires third-party applications to be installed to access unique functions.

 

With iOS 8 Messages, you can easily control h Here’s how to messagemultiple people, name a conversation and leave a conversation in iOS 8Messages.

With iOS 8 Messages, you can easily control how the messages look and how you interact in the conversation. Here’s how to message multiple people, name a conversation and leave a conversation in iOS 8 Messages. 

1. To send a group message in iOS 8 Messages, tap on the new messages icon and enter in the contacts you want to message.

2. Then to give the message a name, tap the Details link and fill in the Group Name. The Details area also will show you where the people are, if they are sharing their location.

3. You can mute notifications in the Details area by sliding on the Do Not Disturb bar. When you’re available to chat again, just slide it off.

4. If you need more people in the conversation tap the plus to add a contact.

5. If you want to remove someone, slide to the right on their name and tap delete.

6. If you want to leave the conversation, scroll to the bottom of the Details area and tap Leave this Conversation.