CubismSdkForNative-5-r.1 linux for OPENGL

Cubism SDK トラブル報告
1

I’m using opengl in the SDK for native, I want to use lip sync, how to do it, I tried to add LAppModel.cpp in the run function in the LAppDelegate.cpp The update function in this, the compilation can pass, but the report is wrong when executing.

2

You can use the API LAppWavFileHandler::Start().

I have never used it, but likely you should call this api at starting the motion.

3

Are you saying that you call this API in the run function, and there seems to be no other steps to update the frame after the call?

4

I don’t know if it’s right to add these to the run function:

Csm::csmString filePath = “Resources/Haru/sounds/haru_Info_04.wav”;
_wavFileHandler.Start(filePath);
//描画更新
_view->Render();

5

No, I said you should call this API at STARTING motions. Not needed to call in the run() function.
Though I checked the source code, already the system has built.

  1. Start() function
    CubismNativeSamples/Samples/OpenGL/Demo/proj.linux.cmake/src/LAppModel.cpp at 19c25eadeb8a3b0a2e482317da1f860e11672b27 · Live2D/CubismNativeSamples · GitHub

  2. Update() function
    CubismNativeSamples/Samples/OpenGL/Demo/proj.linux.cmake/src/LAppModel.cpp at 19c25eadeb8a3b0a2e482317da1f860e11672b27 · Live2D/CubismNativeSamples · GitHub

You are able to refer these codes.

6

Thank you for your answer, but I still don’t understand how to use this, can you understand in more detail, thank you

7

Ok, I’ll explain step by step.

  1. Call Start() Function At Starting Motion
    For example, in LAppModel::StartMotion(), start motions in the official sample. So LAppWavFileHandler::Start() also is called in LAppModel::StartMotion().

  2. Call Update() Function In Every Game Loop
    For example, in LAppModel::Update(), update the models in the official sample, so LAppWavFileHandler::Update also is called in LAppModel::Update().

IMPORTANT:
The lipsync settings is required in your model. You can refer the model “Haru” in the official sample.

8

Thanks for the answer, what I want to know is that I have a wav file that needs to be played, and I am able to synchronize the lip sync when the voice is played, not when I perform a certain action and the lip sync is synchronized

9

Hmm…Likely I can’t help you, sorry.

10

Hello @fancity123 ,

Thank you for your contact.
This is Live2D Support.

In the Sample project, motion playback triggers audio playback and lip-sync. Please refer to the function in the following link.

In the above function, the following code performs audio playback and lip-sync.

By cutting out this code, audio playback and lip-sync can be performed regardless of motion playback.

Best regards.

@obs
Thank you for your support.

11

Thank you for your answer, now I need to display my specified expression, please tell me which function should I use, I do not need to respond to mouse events, please tell me to comment out those functions, I want to improve the efficiency of the program, if I do not use the mouse, please tell me which function should I call to realize the change of role

12

@fancity123

The current SDK sample loops random motion playback, with audio playback and lip-sync tied to each motion.

  1. audio playback without motion playback 2. it is not done with mouse events.
  2. it is not done on mouse events.

If this is the case, I think it would be appropriate to loop the audio random playback.

Looping audio playback requires a function to detect when audio playback is complete, but the SDK sample does not have such a function, so it is necessary to create one.
We will need to create an audio playback completion detection function using the current motion playback completion detection function (CubismNativeFramework/src/Motion/ACubismMotion.cpp at 3d9f82a47f3f9c8c89ae692703f2dad79296b61a · Live2D/CubismNativeFramework · GitHub), it would be possible to loop random audio playback.

Best regards.