The Twilio Programmable Video SDKs use [Semantic Versioning](http://www.semver.org/). Twilio supports version N-1 for 12 months after the first GA release of version N. We recommend you upgrade to the latest version as soon as possible to avoid any breaking changes. Version 2.x is the lastest Video JavaScript SDK. **Version 1.x reached End of Life on September 8th, 2021.** See the changelog entry [here](https://www.twilio.com/changelog/end-of-life-complete-for-unsupported-versions-of-the-programmable-video-sdk). Support for the 1.x version ended on December 4th, 2020. 2.30.0 (March 28, 2025) ======================== New Features ------------ ### WebRTC Overrides (Beta) The SDK now enables you to override WebRTC APIs with the following options. If your environment supports WebRTC redirection—such as [Citrix HDX](https://www.citrix.com/solutions/hdx.html)'s WebRTC [redirection technologies](https://www.citrix.com/blogs/2019/01/15/hdx-a-webrtc-manifesto/)—your application can leverage this new beta feature to enhance media quality in those environments. For more details, please refer to the [JavaScript WebRTC Overrides](https://www.twilio.com/docs/video/javascript-webrtc-overrides) documentation. **ConnectOptions** - `rtcConfiguration` - An optional `RTCConfiguration` object passed to the RTCPeerConnection constructor. - `RTCPeerConnection` - Allows overriding the native `RTCPeerConnection` class. **ConnectOptions and CreateLocalTracksOptions** - `getUserMedia` - Overrides the native `MediaDevices.getUserMedia` API. - `enumerateDevices` - Overrides the native `MediaDevices.enumerateDevices` API. - `MediaStream` - Overrides the native `MediaStream` class. - `mapMediaElement` - Callback triggered after a media track is attached to an audio or video element. - `disposeMediaElement` - Callback triggered after a media track is detached from an audio or video element. Bug Fixes --------- - Fixed a bug where a Chrome iOS Participant's local audio (Krips Noise Cancellation enabled) did not recover after disconnecting a bluetooth headset. (VIDEO-13010) 2.29.0 (December 5, 2024) ================================ Changes ------- ### Video Processor V3 support (Beta) - `AddProcessorOptions.outputFrameBufferContextType = 'bitmaprenderer'` is now supported on Safari and Firefox. (VBLOCKS-3643, VBLOCKS-3644) - `AddProcessorOptions.inputFrameBufferType` now has a new value `videoframe`. On browsers that support [`VideoFrame`](https://developer.mozilla.org/en-US/docs/Web/API/VideoFrame), the `inputFrameBuffer` argument of [`VideoProcessor.processFrame()`](https://twilio.github.io/twilio-video-processors.js/classes/VirtualBackgroundProcessor.html#processFrame) will be a `VideoFrame`. On other supported browsers, it will be an `HTMLVideoElement`. - `AddProcessorOptions.outputFrameBufferContextType` now has a new value `bitmaprenderer`. Currently, this is only **supported for Chromium-based browsers**. On other supported browsers, it falls back to `2d`. - Patched the build script to work around the issue: https://github.com/markdown-it/linkify-it/issues/111. 2.28.2 (November 22, 2024) ========================== Bug Fixes --------- - Fixed a bug in Desktop Safari 18 and all iOS browsers on iOS 18 where cloning a disabled `MediaStreamTrack` would incorrectly set the `enabled` property to `true` instead of preserving the original disabled state. This ensures track cloning behavior matches the MediaStreamTrack specification and works consistently across browsers. Bug report: https://bugs.webkit.org/show_bug.cgi?id=281758 2.28.1 (October 3, 2023) ======================== Bug Fixes --------- - Previously, a Chrome iOS 17 Participant's local audio (Krisp noise cancellation enabled) did not recover after foregrounding the browser following the playing of a YouTube video (or some other application which requires microphone permissions). We work around this by permanently disabling the Krisp noise cancellation upon foregrounding the browser. (VIDEO-13006) 2.28.0 (September 14, 2023) =========================== Bug Fixes --------- - Fixed a bug where a Chrome iOS 17 Participant's local and remote media (Krisp Noise Cancellation enabled) failed to recover after interacting with a PSTN call in full-screen mode. (VIDEO-13011) - Fixed a bug where a Chrome iOS 17 Participant's audio with Krisp Noise Cancellation did not recover after interacting with a system popup. (VIDEO-13012) - Fixed a bug where a Chrome iOS 17 Participant's audio with Krisp Noise Cancellation did not recover after invoking Siri. (VIDEO-13013) 2.27.0 (March 21, 2023) ======================= Changes ------- `VideoTrack.addProcessor` now works on browsers that support `OffscreenCanvas` as well as `HTMLCanvasElement`. When used with [@twilio/video-processors v2.0.0](https://github.com/twilio/twilio-video-processors.js/blob/2.0.0/CHANGELOG.md), the Virtual Background feature will work on browsers that supports [WebGL2](https://developer.mozilla.org/en-US/docs/Web/API/WebGL2RenderingContext). See [VideoTrack.addProcessor](https://sdk.twilio.com/js/video/releases/2.27.0/docs/VideoTrack.html#addProcessor__anchor) and [@twilio/video-processors v2.0.0](https://github.com/twilio/twilio-video-processors.js/blob/2.0.0/CHANGELOG.md) for details. ### Example ```ts import { createLocalVideoTrack } from 'twilio-video'; import { Pipeline, VirtualBackgroundProcessor } from '@twilio/video-processors'; const virtualBackgroundProcessor = new VirtualBackgroundProcessor({ pipeline: Pipeline.WebGL2, // ...otherOptions }); await virtualBackgroundProcessor.loadModel(); const videoTrack = await createLocalVideoTrack({ width: 640, height: 480, frameRate: 24 }); videoTrack.addProcessor(processor, { inputFrameBufferType: 'video', outputFrameBufferContextType: 'webgl2', }); ``` 2.26.2 (February 21, 2023) ========================== Changes ------- - Starting from version 110, Chrome will no longer support the iSAC audio codec. The SDK will now log a warning to the console whenever an audio or a video codec that is specified in `ConnectOptions.preferredAudioCodecs` and `ConnectOptions.preferredVideoCodecs` is not supported by the browser. (VIDEO-12494) Bug Fixes --------- - Fixed a bug on Chrome versions 112+ where `Room.getStats()` did not reject the returned Promise when an exception was raised while accessing WebRTC stats that due to a TypeError caused by trying to read from the now-removed `RTCMediaStreamTrackStats`. (VIDEO-12534) 2.26.1 (January 31, 2023) ========================= Bug Fixes --------- - Fixed a bug that manifests on Chrome versions 112+ where `Room.getStats()` raises an unhandled exception due to a TypeError caused by trying to read from the now-removed `RTCMediaStreamTrackStats`. Instead, the SDK now reads from the `RTCMediaSourceStats`. (VIDEO-12411) - Fixed an error in the type definition for the `attach()` method of `AudioTrack` and `VideoTrack`. (VIDEO-12242) - Fixed an error in the type definition for `createLocalAudioTrack()`. (VIDEO-12383) 2.26.0 (December 14, 2022) ========================== New Features ------------ - The [`LocalAudioTrack`](https://sdk.twilio.com/js/video/releases/2.26.0/docs/LocalAudioTrack.html) and [`LocalVideoTrack`](https://sdk.twilio.com/js/video/releases/2.26.0/docs/LocalVideoTrack.html) classes now provide a new boolean property called `isMuted`, which lets you know if the audio or video source is currently providing raw media samples. The classes also emit `muted` and `unmuted` events if the value of `isMuted` toggles. The application can use these APIs to detect temporary loss of microphone or camera to other applications (ex: an incoming phone call on an iOS device), and update the user interface accordingly. (VIDEO-11360) - The `Room` class provides a new method called [refreshInactiveMedia](https://sdk.twilio.com/js/video/releases/2.26.0/docs/Room.html#refreshInactiveMedia), which restarts any muted local media Tracks, and plays any inadvertently paused HTMLMediaElements that are attached to local and remote media Tracks. This is useful especially on iOS devices, where sometimes your application's media may not recover after an incoming phone call. You can use this method in conjunction with the local media Track's `isMuted` property described previously to recover local and remote media after an incoming phone call as shown below. (VIDEO-11360) ### Vanilla JS #### html ```html ``` #### js ```js const { connect } = require('twilio-video'); const room = await connect('token', { name: 'my-cool-room' }); const $refreshInactiveMedia = document.getElementById('refresh-inactive-media'); $refreshInactiveMedia.onclick = () => room.refreshInactiveMedia(); const [{ track: localAudioTrack }] = [...room.localParticipant.audioTracks.values()]; const [{ track: localVideoTrack }] = [...room.localParticipant.videoTracks.values()]; const isLocalAudioOrVideoMuted = () => { return localAudioTrack.isMuted || localVideoTrack.isMuted; } const onLocalMediaMutedChanged = () => { $refreshInactiveMedia.disabled = !isLocalAudioOrVideoMuted(); }; [localAudioTrack, localVideoTrack].forEach(localMediaTrack => { ['muted', 'unmuted'].forEach(event => { localMediaTrack.on(event, onLocalMediaMutedChanged); }); }); ``` ### React #### src/hooks/useLocalMediaMuted.js ```js import { useEffect, useState } from 'react'; export default function useLocalMediaMuted(localMediaTrack) { const [isMuted, setIsMuted] = useState(localMediaTrack?.isMuted ?? false); useEffect(() => { const updateMuted = () => setIsMuted(localMediaTrack?.isMuted ?? false); updateMuted(); localMediaTrack?.on('muted', updateMuted); localMediaTrack?.on('unmuted', updateMuted); return () => { localMediaTrack?.off('muted', updateMuted); localMediaTrack?.off('unmuted', updateMuted); }; }, [localMediaTrack]); return isMuted; } ``` #### src/components/room.js ```jsx import useLocalMediaMuted from '../hooks/useLocalMediaMuted'; export default function Room({ room }) { const [{ track: localAudioTrack }] = [...room.localParticipant.audioTracks.values()]; const [{ track: localVideoTrack }] = [...room.localParticipant.videoTracks.values()]; const isLocalAudioMuted = useLocalMediaMuted(localAudioTrack); const isLocalVideoMuted = useLocalMediaMuted(localVideoTrack); const isLocalMediaMuted = isLocalAudioMuted || isLocalVideoMuted; const refreshInactiveMedia = () => { room.refreshInactiveMedia(); }; return ( <> ... {isLocalMediaMuted && } ... ); } ``` 2.25.0 (November 14, 2022) ========================== New Features ------------ ### Auto-switch default audio input devices This release adds a new feature that preserves audio continuity in situations where end-users change the default audio input device. A LocalAudioTrack is said to be capturing audio from the default audio input device if: - it was created using the MediaTrackConstraints `{ audio: true }`, or - it was created using the MediaTrackConstraints `{ audio: { deviceId: 'foo' } }`, and "foo" is not available, or - it was created using the MediaTrackConstraints `{ audio: { deviceId: { ideal: 'foo' } } }` and "foo" is not available In previous versions of the SDK, if the default device changed (ex: a bluetooth headset is connected to a mac or windows laptop), the LocalAudioTrack continued to capture audio from the old default device (ex: the laptop microphone). Now, a LocalAudioTrack will switch automatically from the old default audio input device to the new default audio input device (ex: from the laptop microphone to the headset microphone). This feature is controlled by a new [CreateLocalAudioTrackOptions](https://sdk.twilio.com/js/video/releases/2.25.0/docs/global.html#CreateLocalAudioTrackOptions) property `defaultDeviceCaptureMode`, which defaults to `auto` (new behavior) or can be set to `manual` (old behavior). The application can decide to capture audio from a specific audio input device by creating a LocalAudioTrack: - using the MediaTrackConstraints `{ audio: { deviceId: 'foo' } }`, and "foo" is available, or - using the MediaTrackConstraints `{ audio: { deviceId: { ideal: 'foo' } } }` and "foo" is available, or - using the MediaTrackConstraints `{ audio: { deviceId: { exact: 'foo' } } }` and "foo" is available In this case, the LocalAudioTrack DOES NOT switch to another audio input device if the current audio input device is no longer available. See below for the behavior of this property based on how the LocalAudioTrack is created. (VIDEO-11701) ```js const { connect, createLocalAudioTrack, createLocalTracks } = require('twilio-video'); // Auto-switch default audio input devices: option 1 const audioTrack = await createLocalAudioTrack(); // Auto-switch default audio input devices: option 2 const audioTrack1 = await createLocalAudioTrack({ defaultDeviceCaptureMode: 'auto' }); // Auto-switch default audio input devices: option 3 const [audioTrack3] = await createLocalTracks({ audio: true }); // Auto-switch default audio input devices: option 4 const [audioTrack4] = await createLocalTracks({ audio: { defaultDeviceCaptureMode: 'auto' } }); // Auto-switch default audio input devices: option 5 const room1 = await connect({ audio: true }); // Auto-switch default audio input devices: option 6 const room2 = await connect({ audio: { defaultDeviceCaptureMode: 'auto' } }); // Disable auto-switch default audio input devices const room = await createLocalAudioTrack({ defaultDeviceCaptureMode: 'manual' }); ``` **Limitations** - This feature is not enabled on iOS as it is natively supported. - Due to this [WebKit bug](https://bugs.webkit.org/show_bug.cgi?id=232835), MacOS Safari Participants may lose their local audio after switching between default audio input devices two-three times. - This feature is not supported on Android Chrome, as it does not support the [MediaDevices.ondevicechange](https://developer.mozilla.org/en-US/docs/Web/API/MediaDevices/devicechange_event#browser_compatibility) event. 2.24.3 (October 10, 2022) ========================= Bug Fixes --------- - Fixed a bug where iOS Safari Participant could not hear or see others after switching back from YouTube picture-in-picture mode. (VIDEO-11352) - Fixed a bug where iOS Safari Participant could not hear others after switching from recording an audio message in a messenger app. (VIDEO-11354) - Fixed a bug where iOS Safari Participant could not hear or see others after watching a video in another browser tab. (VIDEO-11356) - Fixed a bug where iOS Safari Participant sometimes could not hear or see others after finishing an incoming call in full screen mode. (VIDEO-11359) 2.24.2 (September 29, 2022) =========================== Bug Fixes --------- - Fixed a bug where sometimes, a `MediaClientRemoteDescFailedError` was raised when a Chrome Participant who had enabled Adaptive Simulcast (`ConnectOptions.preferredVideoCodecs = 'auto'`) tried to publish a camera Track after publishing a `` Track. (VIDEO-11516) - Fixed an issue where the Krisp Noise Cancellation fails to load in an application where the content security policy directives `default-src self unsafe-eval` are used. (VIDEO-11537) 2.24.1 (September 6, 2022) ========================== Bug Fixes --------- - Fixed a bug where sometimes a runtime error was raised on iOS devices as shown below. (VIDEO-11263) ``` Unhandled Runtime Error: TypeError: null is not an object (evaluating 'el.paused') ``` - The LocalTrackOptions type definition now contains `logLevel` as an optional property. (VIDEO-10659) - Fixed an issue where the `import` keyword was causing problems in webpack and typescript projects. (VIDEO-11220) 2.24.0 (August 22, 2022) ======================== New Features ------------ - The support for twilio approved 3rd party noise cancellation solutions is now **generally available**. Bug Fixes --------- - Fixed an issue where input media track was not stopped, after `localAudioTrack.stop()` when using noiseCancellation (VIDEO-11047) - Added versioning support for noise cancellation plugin. This SDK will require noise cancellation plugin to be version 1.0.0 or greater. (VIDEO-11087) 2.23.0 (July 28, 2022) ====================== New Features ------------ - This release adds private beta support for 3rd party noise cancellation solution. You need to host twilio approved 3rd party plugin on your web server to enable noise cancellation. Please fill out [this form](https://forms.gle/eeFyoGJj1mgMrxN88) to request access to the 3rd party plugin. Once you get the access to the plugin, You can install it from npm with: ``` npm install ``` Once installed, you need to host the contents of `./node_modules//dist/` from your web server. We recommend that you add plugin version number to the hosted path to ensure that browser does not use [stale version](https://www.keycdn.com/support/what-is-cache-busting) when its updated. You need to pass the path to the hosted files to `twilio-video` sdk when creating audio track as shown in the example below. The example below assumes that you have hosted the files at `/noise_cancellation_plugin/1.0.0/dist` on your web server. ```ts const { connect, createLocalAudioTrack } = require('twilio-video'); // create a local audio track and have it use // @twilio/krisp-audio-plugin for noise cancellation processing. const localAudioTrack = await Video.createLocalAudioTrack({ noiseCancellationOptions: { vendor: 'krisp', sdkAssetsPath: '/noise_cancellation_plugin/1.0.0/dist' } }); // publish the track to a room const room = await connect( token, { tracks: [localAudioTrack] // ... any other connect options }); // you can enable/disable noise cancellation at runtime // using noiseCancellation interface exposed by localAudioTrack function updateNoiseCancellation(enable: boolean) { const noiseCancellation = localAudioTrack.noiseCancellation; if (noiseCancellation) { enable ? noiseCancellation.enable() : noiseCancellation.disable(); } } ``` **NOTE:** If your application is using the `default-src self` content security policy directive, then you should add another directive `unsafe-eval`, which is required for the Krisp Audio Plugin to load successfully. 2.22.2 (July 25, 2022) ====================== Changes ------- - `isSupported` flag now returns `false` if the browser does not support the Unified Plan SDP format. (VIDEO-10307) The following is a list of browsers with Unified Plan as the default SDP format. - Chrome 72+ - Safari 12.1+ - Firefox 38+ 2.22.1 (July 11, 2022) ====================== Bug Fixes --------- - The encoding of audio and screen share Tracks are prioritized in Chrome and Safari, thereby more gracefully degrading their quality in limited network conditions. (VIDEO-10212) 2.22.0 (July 5, 2022) ==================== New Features ------------ This release include the **Media Warnings API (Beta)** to help surface media related warning events on the SDK whenever the media server is not able to detect media from a published audio or video track. ### Example ```js const room = await connect('token', { notifyWarnings: [ 'recording-media-lost' ] // Other connect options }); Array.from(room.localParticipant.tracks.values()).forEach(publication => { publication.on('warning', name => { if (name === 'recording-media-lost') { console.log(`LocalTrack ${publication.track.name} is not recording media.`); // Wait a reasonable amount of time to clear the warning. const timer = setTimeout(() => { // If the warning is not cleared, you can manually // reconnect to the room, or show a dialog to the user }, 5000); publication.once('warningsCleared', () => { console.log(`LocalTrack ${publication.track.name} warnings have cleared!`); clearTimeout(timer); }); } }); }); ``` ### API Definitions #### ConnectOptions - **notifyWarnings** - An array of warnings to listen to. By default, this array is empty and no warning events will be raised. Possible warning values include: - `recording-media-lost` - Raised when the media server has not detected any media on the published track that is being recorded in the past 30 seconds. This usually happens when there are network interruptions or when the track has stopped. #### Events The SDK raises warning events when it detects certain conditions. You can implement callbacks on these events to act on them, or to alert the user of an issue. Subsequently, "warningsCleared" event is raised when conditions have returned to normal. - **LocalTrackPublication.on('warning', callback(name))** - Raised when the published Track encounters a warning. - **LocalTrackPublication.on('warningsCleared', callback())** - Raised when the published Track cleared all warning. - **LocalParticipant.on('trackWarning', callback(name, publication))** - Raised when one of the LocalParticipant's published tracks encounters a warning. - **LocalParticipant.on('trackWarningsCleared', callback(publication))** - Raised when one of the LocalParticipant's published tracks cleared all warning. - **Room.on('trackWarning', callback(name, publication, participant))** - Raised when one of the LocalParticipant's published tracks in the Room encounters a warning. - **Room.on('trackWarningsCleared', callback(publication, participant))** - Raised when one of the LocalParticipant's published tracks in the Room cleared all warning. 2.21.3 (June 7, 2022) ==================== Bug Fixes --------- - Fixed an issue where the generated API documentation has a missing search bar. (VIDEO-10199) 2.21.2 (June 1, 2022) ===================== Bug Fixes --------- - Fixed an issue where publishing a video track sometimes caused a failure with "Unhandled exception: Client is unable to create or apply a local media description". (VIDEO-9511) - Fixed an issue where the `dimensionsChanged` event was not firing when the track dimensions first became available. (VIDEO-3576) - Removed references to node dependencies that causes build errors on Angular and Vue. (VIDEO-9282) - Fixed an issue where incorrect device was detected when using iPad in Desktop Website mode. (VIDEO-8282) 2.21.1 (March 22, 2022) ======================= Bug Fixes --------- - Fixed the issue where twilio-video.js does not build with the latest version of webpack and vite. (VIDEO-8609) 2.21.0 (March 8, 2022) ====================== New Features ------------ - twilio-video.js now supports WKWebView and SFSafariViewController on iOS version 14.3 or later. The [`isSupported` flag](https://sdk.twilio.com/js/video/releases/2.20.1/docs/module-twilio-video.html) relies partly on the [User-Agent string](https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/User-Agent) to determine if twilio-video.js officially supports the user's browser. If your application modifies the default value for the User-Agent string, the new value should follow the [correct format](https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/User-Agent#syntax). Additionally, for [iOS applications](https://developer.apple.com/documentation/avfoundation/cameras_and_media_capture/requesting_authorization_for_media_capture_on_ios), your application will need to include the [camera usage description](https://developer.apple.com/library/archive/documentation/General/Reference/InfoPlistKeyReference/Articles/CocoaKeys.html#//apple_ref/doc/plist/info/NSCameraUsageDescription), [microphone usage description](https://developer.apple.com/library/archive/documentation/General/Reference/InfoPlistKeyReference/Articles/CocoaKeys.html#//apple_ref/doc/uid/TP40009251-SW25) and [inline media playback](https://developer.apple.com/documentation/webkit/wkwebviewconfiguration/1614793-allowsinlinemediaplayback) in order for the SDK to work on WKWebView. Note: As with Safari, WKWebViews only support only one local media track of each kind at a time. We also would like to thank @cbxp for his [contribution](https://github.com/twilio/twilio-webrtc.js/pull/133). (VIDEO-8374) Known Issue ----------- Some [common issues](https://github.com/twilio/twilio-video.js/blob/master/COMMON_ISSUES.md#safari-mobile) such as interruptions on mobile devices which includes, backgrounding the application, or switching between applications can sometimes cause VideoTracks to go black or AudioTracks to stop. 2.20.1 (Feb 17, 2022) ===================== Bug Fixes --------- - Fixed a bug that was introduced in 2.19.0 where the published LocalVideoTracks of Participants on older iOS versions 14.5 and below did not encode and transmit media. (VIDEO-8770) 2.20.0 (February 10, 2022) ========================== Changes ------- The Preflight API ([runPreflight](https://sdk.twilio.com/js/video/releases/2.20.0/docs/module-twilio-video.html#.runPreflight__anchor)), originally released in [2.16.0](#2160-august-11-2021), has been promoted to GA. Thank you @morninng @eroidaaruqaj [#1622](https://github.com/twilio/twilio-video.js/issues/1622) for your feedback. Based on this feedback, we have made the following changes to `runPreflight`. (VIDEO-7728) - The [failed](https://sdk.twilio.com/js/video/releases/2.20.0/docs/PreflightTest.html#event:failed) event now provides a [PreflightTestReport](https://sdk.twilio.com/js/video/releases/2.20.0/docs/global.html#PreflightTestReport) which include partial results gathered during the test. Use this in addition to the error object to get more insights on the failure. - Signaling and Media Connection errors are now properly surfaced via the [failed](https://sdk.twilio.com/js/video/releases/2.20.0/docs/PreflightTest.html#event:failed) event. - [PreflightTestReport](https://sdk.twilio.com/js/video/releases/2.20.0/docs/global.html#PreflightTestReport) now includes a `progressEvents` property. This new property is an array of [PreflightProgress](https://sdk.twilio.com/js/video/releases/2.20.0/docs/global.html#PreflightProgress) events detected during the test. Use this information to determine which steps were completed and which ones were not. You can learn more about `runPreflight` usage in the documentation, [here](https://twilio.com/docs/video/troubleshooting/preflight-api). Other changes in this release includes: - In [October 2019](#200-beta15-october-24-2019), twilio-video.js started using Unified Plan where available, while also maintaining support for earlier browser versions with Plan B as the default SDP format. With this release, twilio-video.js will now stop supporting the Plan B SDP format and will only support the Unified Plan SDP format. Please refer to this [changelog](#200-beta15-october-24-2019) and this [public advisory](https://support.twilio.com/hc/en-us/articles/360039098974-Upcoming-Breaking-Changes-in-Twilio-Video-JavaScript-SDK-Google-Chrome) for more related information. (VIDEO-6587) 2.19.1 (February 7, 2022) ========================= Bug Fixes --------- - Fixed a bug where media connection was not getting reconnected after a network interruption if participant was not subscribed to any tracks. (VIDEO-8315) - Fixed a bug where network quality score stops updating after network glitches. (VIDEO-8413) 2.19.0 (January 31, 2022) ========================= New Features ------------ - This release introduces a new feature **Adaptive Simulcast**. This opt-in feature can be enabled by setting `preferredVideoCodecs="auto"` in ConnectOptions. When joining a group room with this feature enabled, the SDK will use VP8 simulcast, and will enable/disable simulcast layers dynamically, thus improving bandwidth and CPU usage for the publishing client. It works best when used along with `Client Track Switch Off Control` and `Video Content Preferences`. These two flags allow the SFU to determine which simulcast layers are needed, thus allowing it to disable the layers not needed on publisher side. This feature cannot be used alongside `maxVideoBitrate`. If your application is currently using VP8 simulcast we recommend that you switch to this option. Example: ```ts const { connect } = require('twilio-video'); const room = await connect(token, { preferredVideoCodecs: 'auto', bandwidthProfile: { video: { contentPreferencesMode: 'auto', clientTrackSwitchOffControl: 'auto' } } }); ``` Known Limitations ----------------- - Specifying `preferredVideoCodecs="auto"` will revert to unicast in the following cases: - The publisher is using Firefox. - The publisher has preferred the H264 codec. - The Room is configured to support only the H264 codec. - Peer-to-Peer Rooms - When the participant is being recorded, the SFU will not disable any simulcast layers of the participant's VideoTrack. Bug Fixes --------- - Fixed a bug where `clientTrackSwitchOffControl` and `contentPreferencesMode` sometimes did not work as expected during network glitches. (VIDEO-7654) 2.18.3 (January 4, 2022) ======================== Bug Fixes --------- - Fixed a bug where connect was returning a Promise type instead of a CancelablePromise. (VIDEO-7831) - Fixed a bug where `audioLevel`, `frameRate`, and `captureDimensions` WebRTC stats are returning null on certain browsers. With this release, these stats are now populated whenever they are available. (VIDEO-3600) 2.18.2 (December 15, 2021) ========================== Bug Fixes --------- - Fixed a bug where setting `clientTrackSwitchOffControl` to `auto` caused the RemoteVideoTracks to get switched off while playing in picture-in-picture mode. Note that this fix does not apply to Firefox as it does not yet implement [picture-in-picture](https://developer.mozilla.org/en-US/docs/Web/API/Picture-in-Picture_API) APIs. (VIDEO-6677) 2.18.1 (October 29, 2021) ========================= Changes ------- - Added some metrics to track the usage of the **Preflight API Public Beta** (`runPreflight`). There are no changes to the public APIs in this release. (VIDEO-6891) 2.18.0 (October 13, 2021) ========================= New Features ------------ - When a LocalParticipant tries to publish a LocalVideoTrack in an [Audio Only Group Room](https://www.twilio.com/docs/video/api/rooms-resource#example-4-create-an-audio-only-group-room), it will fail with a [RoomTrackKindNotSupportedError](https://sdk.twilio.com/js/video/releases/2.18.0/docs/RoomTrackKindNotSupportedError.html). (VIDEO-7242) Known Issue ------------ In Firefox, although the publishing of a LocalVideoTrack in an Audio Only Group Room fails, the **RoomTrackKindNotSupportedError** is not raised. We are actively working on fixing this issue. 2.17.1 (September 21, 2021) =========================== Bug Fixes --------- - Fixed a regression in `2.17.0` which caused Chrome screen share tracks to be encoded at lower dimensions. (VIDEO-7000) 2.17.0 (September 14, 2021) =========================== New Features ------------ - twilio-video.js now supports Chrome on iOS versions 14.3 and above. (VIDEO-5723) Bug Fixes --------- - Fixed a bug where the VideoTracks of Safari Participants with VP8 simulcast enabled sometimes had low frame rates. (VIDEO-6263) - Fixed a bug where the screen share track got restarted as a camera track if it was ended when the application was foreground. (VIDEO-3977) 2.16.0 (August 11, 2021) ======================== **New Features** ----------------------- This release includes the **Preflight API Public Beta** (`runPreflight`) to help test connectivity with Twilio servers. It can be used to detect issues prior to joining a Video Room or as part of a troubleshooting page. The API connects two peer connections using Twilio's Signaling and TURN servers. It publishes synthetic audio and video tracks from one participant and ensures that other participant receives media on those tracks. After successfully verifying connectivity, it generates a report with information on the connection. `runPreflight` was originally introduced as an experimental API in `2.8.0-beta1` and has been updated based on feedback. In short, usage of the API will now be free of charge. Example: ```ts const { runPreflight } = require('twilio-video'); const token = getAccessToken(); const preflightTest = runPreflight(token); preflightTest.on('progress', (progress: string) => { console.log('preflight progress:', progress); }); preflightTest.on('failed', (error: Error) => { console.error('preflight error:', error); }); preflightTest.on('completed', (report: PreflightTestReport) => { console.log("Test completed in " + report.testTiming.duration + " milliseconds."); console.log(" It took " + report.networkTiming.connect?.duration + " milliseconds to connect"); console.log(" It took " + report.networkTiming.media?.duration + " milliseconds to receive media"); }); ``` The [PreflightTestReport](https://sdk.twilio.com/js/video/releases/2.16.0/docs/global.html#PreflightTestReport) generated by `preflightTest` on `completed` provides statistics that can be useful in cases where there is a poor connection. Some of the useful statistics in the report are as follows: - Packet loss, round trip time, and jitter observed on the connection - Network timing measurements on the `progress` events, such as time to connect or to receive media. - Ice candidates and selected ice candidate pairs `preflightTest` emits a `failed` event to indicate test failures. You can use the [PreflightProgress](https://sdk.stage.twilio.com/js/video/releases/2.16.0/docs/global.html#PreflightProgress) events to better understand where the test failed and refer to [this guide](https://www.twilio.com/docs/video/build-js-video-application-recommendations-and-best-practices#connection-errors) for interpreting common errors. A few things to note: - This function uses web audio API's. Browser's autoplay policies sometimes require user action before accessing these APIs. Please ensure that this API is called in response to user action like a button click. - For testing limitations in available bandwidth, we recommend you use `testMediaConnectionBitrate` from the [RTC Diagnostics SDK](https://github.com/twilio/rtc-diagnostics). Bug Fixes --------- Fixed a bug where the SDK was holding on to internally maintained audio elements longer than needed, now they will be cleaned up once track has started. (VIDEO-6480) 2.15.3 (July 28, 2021) ====================== Bug Fixes --------- Fixed a bug where the SDK was not cleaning up internally maintained media elements. This causes memory leaks on certain use cases such as reconnecting or republishing to a room (VIDEO-6336). Additionally, Chrome 92 [started enforcing](https://chromium-review.googlesource.com/c/chromium/src/+/2816118) limit on number of WebMediaPlayers. This blocks creation of WebMediaPlayers once the limit is reached - 75 for desktop and 40 for mobile. This SDK update will help prevent running into this limit issue on use cases such as reconnecting or republishing to a room. Please ensure that your application cleans up media elements as well after they are detached. ```js const elements = track.detach(); elements.forEach(el => { el.remove(); el.srcObject = null; }); ``` Please be aware that your application may still run into the Chrome's WebMediaPlayers limit for large rooms where participants exceeds this limit. 2.15.2 (July 15, 2021) ====================== Bug Fixes --------- Fixed a bug where setting clientTrackSwitchOffControl to `auto` caused the tracks to get switched off aggressively, which resulted in momentary black track during app layout changes (VIDEO-5226). 2.15.1 (June 21, 2021) ===================== New Features ------------ _Updated June 24, 2021_ - The [Video Processor API](https://sdk.twilio.com/js/video/releases/2.15.1/docs/VideoTrack.html#addProcessor) has been promoted to GA. There are no changes to the API at this moment and we will continue to improve it on future releases. Bug Fixes --------- - Fixed a bug where twilio-video was throwing an exception in a server-side rendering application. 2.15.0 (June 16, 2021) ===================== **Breaking Change on Video Processor API (Beta)** ------------------------------------------------- [VideoProcessor.processFrame](https://sdk.twilio.com/js/video/releases/2.15.0/docs/global.html#VideoProcessor) method signature has been changed in order to improve the performance of the [Video Processor API](https://sdk.twilio.com/js/video/releases/2.15.0/docs/VideoTrack.html#addProcessor). With this update, the output frame buffer is now provided to the `processFrame` method which should be used to draw the processed frame. Old signature: ```ts processFrame(inputFrame: OffscreenCanvas) : Promise | OffscreenCanvas | null; ``` New signature: ```ts processFrame(inputFrameBuffer: OffscreenCanvas, outputFrameBuffer: HTMLCanvasElement) : Promise | void; ``` Example: ```js class GrayScaleProcessor { constructor(percentage) { this.percentage = percentage; } processFrame(inputFrameBuffer, outputFrameBuffer) { const context = outputFrameBuffer.getContext('2d'); context.filter = `grayscale(${this.percentage}%)`; context.drawImage(inputFrameBuffer, 0, 0, inputFrameBuffer.width, inputFrameBuffer.height); } } Video.createLocalVideoTrack().then(function(videoTrack) { videoTrack.addProcessor(new GrayScaleProcessor(100)); }); ``` Bug Fixes --------- - Fixed a bug where `isSupported` was returning `true` on certain unsupported mobile browsers. With this release, `isSupported` should now return true only for the [browsers supported by twilio-video.js](https://www.twilio.com/docs/video/javascript#supported-browsers). - Updated [NetworkQualityBandwidthStats](https://sdk.twilio.com/js/video/releases/2.14.0/docs/NetworkQualityBandwidthStats.html) documentation to reflect the correct bandwidth units, in bits per second, instead of bytes. 2.14.0 (May 11, 2021) ===================== New Features ------------ This release contains a significant update to the Bandwidth Profile API. It allows for more efficient use of bandwidth and CPU in multi-party applications. In addition it provides developers with more dynamic control over which video tracks are delivered to the client and the preferred video resolution of the tracks. These capabilities are provided via the Client Track Switch Off Control and Content Preferences settings. Existing Bandwidth Profile settings will continue to function as before, however we recommend developers update their Bandwidth Profile settings to make use of these new capabilities at their earliest convenience. **Client Track Switch Off Control** - This feature allows subscribers to control whether the media for a RemoteVideoTrack is received or not. Client Track Switch Off Control has two modes of operation: - **auto** (default): The SDK determines whether tracks should be switched off based on document visibility, track attachments, and / or the visibility of video elements. - **manual**: The application requests that individual tracks be switched off or on using the `RemoteVideoTrack.switchOff()` / `switchOn()` methods. - Note: If your application previously set the `maxTracks` property to limit the number of tracks visible, you should migrate to using `clientTrackSwitchOffControl` to take advantage of this feature. **Video Content Preferences** - This feature allows subscribers to specify preferences about the media that they receive on a RemoteVideoTrack. Video content preferences has two modes of operation: - **auto** (default): The SDK specifies content preferences based on video element size. A RemoteVideoTrack attached to a video element with larger dimensions will get a higher quality video compared to a RemoteVideoTrack attached to a video element with smaller dimensions. - **manual**: The application specifies the content preferences for individual tracks using `RemoteVideoTrack.setContentPreferences()`. - Note: If your application previously set the `renderDimensions` property, you should migrate to using `contentPreferencesMode` to take advantage of this feature. Both of these features are available in Group Rooms and are enabled by default if your application specifies [Bandwidth Profile Options](https://media.twiliocdn.com/sdk/js/video/releases/2.14.0/docs/global.html#BandwidthProfileOptions__anchor) during connect. ```ts const { connect } = require('twilio-video'); const room = await connect(token, { name: 'my-new-room', bandwidthProfile: { video: { /* Defaults to "auto" for both features. Be sure to remove "renderDimensions" and "maxTracks". */ } } }); ``` **Migrating to Attach APIs** The automatic behaviors rely on applications using the [attach](https://media.twiliocdn.com/sdk/js/video/releases/2.12.0/docs/RemoteVideoTrack.html#attach__anchor) and [detach](https://media.twiliocdn.com/sdk/js/video/releases/2.12.0/docs/RemoteVideoTrack.html#detach__anchor) methods of `RemoteVideoTrack`. If your application currently uses the underlying `MediaStreamTrack` to associate Tracks to video elements, you will need to update your application to use the attach/detach methods or use the manual APIs. **Manual Controls** ```ts const room = await connect(token, { bandwidthProfile: { video: { contentPreferencesMode: 'manual', clientTrackSwitchOffControl: 'manual' } } }); ``` When manual controls are used you can operate directly on `RemoteVideoTrack` to specify preferences. For example, applications can: 1. Force disabling a track. ```ts remoteTrack.switchOff(); ``` 2. Enable and request QVGA video. ```ts # Only needed if switchOff() was called first. remoteTrack.switchOn(); remoteTrack.setContentPreferences({ renderDimensions: { width: 320, height: 240 } }); ``` 3. Request HD (720p) video. ```ts remoteTrack.setContentPreferences({ renderDimensions: { width: 1280, height: 720 } }); ``` - `clientTrackSwitchOffControl` Optional property (defaults to `"auto"`). When omitted or set to "auto" switches off a `RemoteVideoTrack` when no video element is attached to the track, when all attached video elements of the track are not visible, or when the Document is not visible. - `contentPreferencesMode` Optional property (defaults to `"auto"`). When omitted or set to `"auto"` allows the SDK to select video bitrate based on dimension information of the video elements attached to each `RemoteVideoTrack`. - `renderDimensions` is deprecated and will raise a warning when set. Setting both `renderDimensions` and `contentPreferencesMode` is not allowed and will raise an exception. - `maxTracks` is deprecated and will raise a warning when set. Setting both `maxTracks` and `clientTrackSwitchOffControl` is not allowed and will raise an exception. Bug Fixes --------- - Fixed a bug where loading `twilio-video.js` resulted in page errors on Firefox Galaxy S9 simulation mode. (VIDEO-4654) - Fixed LocalDataTrackOptions TypeScript Definition to match documentation and extend properties from LocalTrackOptions. (VIDEO-5116) 2.13.1 (March 17, 2021) ======================= New Features ------------ - The [Video Processor API](https://sdk.twilio.com/js/video/releases/2.13.0/docs/VideoTrack.html#addProcessor) has been promoted to beta. There are no changes to the API at this moment and we will continue to improve it on future releases. Bug Fixes --------- - Fixed a bug where Android Firefox Participants sometime failed to publish VP8 VideoTracks in a Group Room. (VIDEO-3736) 2.13.0 (March 3, 2021) ====================== New Features ------------ **Video Processor API Pilot (Chrome only)** - You can now register a `VideoProcessor` with a VideoTrack in order to process its video frames. In a LocalVideoTrack, video frames are processed before being sent to the encoder. In a RemoteVideoTrack, video frames are processed before being sent to the attached `