Gestures
are a vital part of the screen reader. They allow the user to navigate onscreen elements, execute a variety of functions, and change options quickly. Jieshuo Screen Reader enables assigning gestures to all of its functions, in addition to opening apps, using custom user functions, activating timers, and accessing extensions and tools.
By default, Jieshuo includes a set of functions assigned to some gestures, while others remain unassigned. Although modifying the default gesture scheme is not possible, users can utilize the “Custom gesture scheme” or create new global or per-app gesture schemes, assigning gestures as they prefer. It is also possible to download schemes created by other users or share custom schemes with others.
Table of Contents
Global vs. Per-App Gesture Schemes
There are two types of gesture schemes based on where they are used. The global gesture scheme applies everywhere, regardless of the app or window. In contrast, a per-app gesture scheme is specific to a certain app and is only active when that app is in the foreground.
When an app has a per-app gesture scheme and this scheme is enabled, Jieshuo automatically switches to it when the app is opened and keeps it active until the user leaves the app. Note that per-app gesture schemes are only available for pro subscribers.
Creating and Customizing Gesture Schemes
To use custom gesture schemes, the user must enable the “Use custom gestures” option found in “Screen Reader Settings” > “General Settings.”
As mentioned in the introduction, there is already a gesture scheme called “Custom” that users can modify. A shortcut to this scheme is also available in General Settings.
Creating New Schemes and Editing Available Ones
After opening “Screen Reader Settings” and navigating to “Operation Settings”, several sections related to gesture schemes are available:
- Gesture Scheme: Contrary to what the name might suggest, this section only allows selecting between the default gesture scheme and the custom one. Other global schemes do not appear in the list, but the name of the selected global scheme is displayed next to the section’s name.
- Gesture Schemes Settings (followed by the name of the scheme in use): This section allows modifications to the currently used global scheme.
- Gesture Scheme Description: Displays the functions assigned to gestures in the scheme that is currently in use.
- Gesture Scheme Manager: Lists all created and imported gesture schemes, providing options to modify or create new ones.
- Per-Application Gesture Scheme: Displays per-app gesture schemes, allowing users to choose which ones to use. If an item is unchecked, Jieshuo will not switch to the per-app gesture scheme for that app and will continue using the global scheme instead.
Creating New Schemes
In Gesture Scheme Manager, press the “New” button to create a new scheme. Enter a name and press “OK.” A list of available gestures will then be displayed. Double-tapping any gesture allows modification. The available options are:
- Default: Uses the default function assigned to the gesture.
- No Command: Leaves the gesture unassigned.
- Plugins: Opens the list of imported and created extensions to choose from.
- Custom Voice Commands: Opens the list of available custom voice commands for selection.
- Tools: Displays all created and imported tools.
- Timer: Allows selecting a preset timer, starting a stopwatch immediately, or asking every time the gesture is executed.
- Application: Shows a list of installed apps, allowing the user to assign one to open with the gesture.
- Function: Lists all Jieshuo functions.
- All user-created functions: All custom-created functions are shown as separate items after the already mentioned sections. Unlike extensions and tools, these can be assigned to gestures in the free version. However, there is no search function for quickly finding items.
After opening any section, the user can search using the “Enter a new word” option. As they type, matching results appear above the keyboard.
Once modifications are complete, the user can tap “Save” or simply exit the window—changes will be saved automatically when navigating back or returning to the home screen.
While editing the gesture scheme, tap “More Options” to access the following:
- Create a New Function: Allows creating a custom function either by writing it after giving it a name and tapping “OK,” or by pasting code shared by others. Tap “Save” to store the function.
- Create a New Automatic Click Function: This is a specific Jieshuo custom function that uses the click service. After saving the function for the first time, Jieshuo formats it as a service click. Users should consider this, as pasting text without modification is not suitable for this option. Auto clicks can still be included in other functions if the user prefers not to type manually by selecting “More Options” while creating a new function.
- Functions Manager: Displays all created functions with options to edit, rename, or delete them.
- New Voice Command: Primarily intended for voice commands, but a voice command can also be triggered using gestures if the user prefers not to use the voice assistant.
- Voice Command Manager: Lists all created voice commands.
In both the Functions Manager and Voice Command Manager, tapping “New” allows creating a new function or voice command. In Functions Manager, the “New” option opens the standard function creation tool, not the automatic click function, so Jieshuo does not apply additional formatting.
This guide does not cover function creation.
Modifying Created or Imported Gesture Schemes
In Gesture Scheme Manager, selecting any gesture scheme enables editing it. The same options and methods discussed in the Creating New Schemes section apply here.
Switching to a Gesture Scheme
Before going into details, it is important to clarify that per-app gesture schemes are standard gesture schemes that can be assigned to specific apps. This means a per-app gesture scheme can also be used as the global scheme. Jieshuo recognizes a gesture scheme as a per-app scheme based on its name—it must match the app’s name. So, when creating a new gesture scheme and naming it after an installed app, it can function as a per-app gesture scheme.
After creating or editing a scheme that is not the currently used scheme, a dialog will appear asking whether to switch to it. If the scheme’s name matches an installed app, two options will be available in addition to “Cancel”:
- “Enable as a Per-App Gesture Scheme”
- “Enable as a Global Gesture Scheme”
If the scheme’s name does not match any installed app, the per-app gesture scheme option will not be shown.
Note: Selecting a gesture and reassigning the same function it already had is enough to trigger the dialog. For example, if a gesture is set to “Default,” simply selecting “Default” again will prompt the dialog.
Creating Gesture Schemes Using the “Edit Current Per-App Gesture Scheme” Function
The “Edit Current Per-App Gesture Scheme” function in Jieshuo, available in the main menu and assignable to gestures, can be used to either edit an existing per-app gesture scheme or create a new one.
When using this function while inside an app, Jieshuo creates a gesture scheme named after the app, allowing gestures to be assigned as needed. Once finished, the same dialog mentioned earlier will appear, offering options to enable the scheme as either a global or per-app scheme.
If the app already has a gesture scheme, even if it is not currently active, this function allows modifications to be made to the scheme.
Multi-Finger and Multi-Part Gestures
Multi-Finger Gestures
For an unknown reason, multi-finger gestures are not enabled by default in Jieshuo, meaning they do not appear when assigning gestures in schemes.
To enable them:
- Open Screen Reader Settings.
- Navigate to Operation Settings.
- Select Gestures Default Settings.
- Check the “Use Multi-Finger Gestures” option.
Once enabled, multi-finger gestures will be available in all gesture schemes.
To temporarily disable multi-finger gestures, activate the “Toggle Multi-Finger Gestures” function. Using the same function will re-enable them.
Note: The effect of this function is temporary—after turning Jieshuo off and back on, the state will revert to what is set in the settings.
Multi-Part Gestures
Multi-part gestures are additional gestures that can be used in both global and per-app gesture schemes. They are formed by performing two gestures—either one-finger or multi-finger—consecutively. In other words, a multi-part gesture consists of two selected gestures performed in sequence.
By default, multi-part gestures are not enabled, and even when enabled, they are set to No Action until the user modifies the gesture.
To enable multi-part gestures:
- Go to Gestures Default Settings.
- Check the option to enable multi-part gestures.
In the same settings section, you can specify the duration for Jieshuo to recognize the next gesture to form a multi-part gesture. The duration is measured in milliseconds and ranges from 250 to 1000 milliseconds (1 second). For example, if the duration is set to 1000 ms and the first gesture of a multi-part sequence is performed, Jieshuo will wait to see if the second part is completed within the set recognition time. If it is not detected, Jieshuo will treat the gesture as a single-part gesture.
Once multi-part gestures are enabled, they will appear in all gesture schemes, whether for one-finger or multi-finger gestures. Note that long gestures
cannot be used in multi-part gestures.
Other Gesture Scheme-Related Functions
- To hear what all gestures are assigned to in the current scheme, activate the “Gesture Scheme Description” function.
- To see a list of per-app gestures in the per-app scheme, use the “Current Per-App Gestures Menu” function. This works only if the app has a gesture scheme, whether it is currently active or not. The menu displays all functions dedicated to gestures in the scheme, excluding Jieshuo functions. Pressing any of the items will execute the associated action.
Sharing and Downloading Gesture Schemes
To see all available global gesture schemes on the Jieshuo server while editing or creating a new scheme, tap the item labeled “Share”. This will display all uploaded gesture schemes, allowing you to download and import any of them. Alternatively, gesture schemes can be downloaded using the “Download Additional Resources” menu in Screen Reader Settings.
To share your own scheme, go to the Gesture Schemes Manager, long press any scheme, and select “Share” to upload it to the server for others to download. If you choose “Send” instead, you will have the option to send the gesture scheme to others in the way you prefer. Others can then download the gesture scheme and import it into Jieshuo.
The Gestures Folder
Each gesture scheme is stored in a folder with its name inside the Gestures folder, located within the main Jieshuo folder, which is in Chinese. Along with the custom functions files, there is a config file that determines the gestures used and what they are assigned to. You can open this file to see its structure and, if you prefer, make edits to it.
Conclusion
Gesture schemes offer flexibility, allowing you to assign gestures according to your preferences and set specific schemes for particular apps. While managing gesture schemes may seem complicated for beginners, taking the time to understand how they work will make things easier. Many users find the default custom gesture scheme sufficient as the global scheme that can be edited. If you choose to explore gesture schemes created by others, it’s important to proceed with caution, as these schemes can contain custom functions that may be harmful if uploaded with malicious intent. As with extensions and tools, always exercise caution when downloading schemes from untrusted sources.
Comments