Base solution for your next web application
Open Closed

Application lost response sometimes #5267

User avatar
0
trendline created

It is a very odd behavior, and confused me recent days. The application will lost response sometimes in a random chance, the client cannot get any response from the server.

First, the Tenancy specified access lost response from the server, then if clean the client cookie, it could access to the Host dashboard, but cannot impersonation to any Tenant, if try to impersonation a Tenant, then it will blocked on the redirect screen.

After several tries, the Host dashboard also will lost response from the server, by this time, all site lost response from the server.

The odd thing is all of these behaviors without exception logs to record, the server level or the application level both are looks work good, and the w3p.exe, application dotnet.exe both are working fine.

During the no response time, the application logs recorded request are received by the application, but cannot return any result to client. It will stop after redirect the route to login action of the account controller.

Every time encountered this behavior only restart the application pool could let the application run normally, no other approach can fix it.

Anybody have this issue too?

It is running under Zero v5.5.0, host on IIS 10 on Windows Server 2012 with SQL Server 2017 as the DB server.

Go to accepted answer
38 Answer(s)
  • User Avatar
    0
    ismcagdas created
    Support Team

    @trendline are you using ASP.NET Core MVC & JQuery version ? If so, could you try this fix <a class="postlink" href="https://github.com/aspnetzero/aspnet-zero-core/issues/1287">https://github.com/aspnetzero/aspnet-ze ... ssues/1287</a> ?

  • User Avatar
    0
    trendline created

    Yes, I am using the MVC&jQuery edition, I already found this fix and applied, the application is running normally almost one day, I hope this issue is the reason behind and it could be fixed by this approach.

    Thanks for your information.

  • User Avatar
    0
    ismcagdas created
    Support Team

    Ok, please let us know if you face the same problem again.

  • User Avatar
    0
    trendline created

    Unfortunately, this is not the real reason, after a new deployment, it happened again. logs record below repeated logs as below:

    INFO  2018-06-22 09:12:01,820 [10   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.0 HEAD http://127.0.0.1:14395/  
INFO  2018-06-22 09:12:01,829 [10   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Home", area = ""}. Executing action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-22 09:12:01,832 [10   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) with arguments (, False) - Validation state: Valid
INFO  2018-06-22 09:12:01,832 [10   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.RedirectToActionResult in 0.0266ms.
INFO  2018-06-22 09:12:01,844 [10   ] ft.AspNetCore.Mvc.RedirectToActionResult - Executing RedirectResult, redirecting to /Account/Login.
INFO  2018-06-22 09:12:01,844 [10   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) in 15.145ms
INFO  2018-06-22 09:12:01,845 [10   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 24.635ms 302 
INFO  2018-06-22 09:18:12,102 [38   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.0 HEAD http://127.0.0.1:14395/  
INFO  2018-06-22 09:18:12,109 [38   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Home", area = ""}. Executing action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-22 09:18:12,111 [38   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) with arguments (, False) - Validation state: Valid
INFO  2018-06-22 09:18:12,111 [38   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.RedirectToActionResult in 0.0274ms.
INFO  2018-06-22 09:18:12,122 [38   ] ft.AspNetCore.Mvc.RedirectToActionResult - Executing RedirectResult, redirecting to /Account/Login.
INFO  2018-06-22 09:18:12,122 [38   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) in 12.2954ms
INFO  2018-06-22 09:18:12,122 [38   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 20.5415ms 302 
INFO  2018-06-22 09:19:50,981 [25   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.0 HEAD http://127.0.0.1:14395/  
INFO  2018-06-22 09:19:50,988 [25   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Home", area = ""}. Executing action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-22 09:19:50,990 [25   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) with arguments (, False) - Validation state: Valid
INFO  2018-06-22 09:19:50,990 [25   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.RedirectToActionResult in 0.0244ms.
INFO  2018-06-22 09:19:51,002 [25   ] ft.AspNetCore.Mvc.RedirectToActionResult - Executing RedirectResult, redirecting to /Account/Login.
INFO  2018-06-22 09:19:51,002 [25   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) in 13.4572ms
INFO  2018-06-22 09:19:51,002 [25   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 21.0892ms 302 
INFO  2018-06-22 09:22:22,434 [65   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.0 HEAD http://127.0.0.1:14395/  
INFO  2018-06-22 09:22:22,442 [65   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Home", area = ""}. Executing action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-22 09:22:22,444 [65   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) with arguments (, False) - Validation state: Valid
INFO  2018-06-22 09:22:22,445 [65   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.RedirectToActionResult in 0.0276ms.
INFO  2018-06-22 09:22:22,453 [65   ] ft.AspNetCore.Mvc.RedirectToActionResult - Executing RedirectResult, redirecting to /Account/Login.
INFO  2018-06-22 09:22:22,453 [65   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) in 10.8877ms
INFO  2018-06-22 09:22:22,454 [65   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 19.8017ms 302
  • User Avatar
    0
    ismcagdas created
    Support Team

    @trendline It seems like there is no error on the log file. Have you tried setting your IIS application pool to Always On mode ?

  • User Avatar
    0
    trendline created

    @ismcagdas, yes, the application pool start model is always running, furthermore application pool without recycling.

    It is a so urgently confusion issue, I don't kown when the application will not availble, online service is unreliable。

  • User Avatar
    0
    trendline created

    Updated.

    when visit a service, suddenly, the server lost response, below logs recorded the request event, before server lost response I am visiting the GetAll method of the Bunk Service, then a Error Redirect action be recorded, but client cannot get any response from server, and other requests all blocked there, event the application received the request, but no response sent to client.

    Any logs for the error redirection could be recorded? there is no error or exception system logs on the OS.

    INFO  2018-06-24 10:32:31,355 [14   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/api/services/ga/Bunk/GetAll?filter=115&numberFilter=&descriptionFilter=&roomNameFilter=&userNameFilter=&stateIdFilter=&maxCheckInTimeFilter=&minCheckInTimeFilter=&maxCheckOutTimeFilter=&minCheckOutTimeFilter=&nameFilter=&sorting=bunk.number%20asc&skipCount=0&maxResultCount=10 application/json 
INFO  2018-06-24 10:32:31,364 [14   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "ga", action = "GetAll", controller = "Bunk"}. Executing action Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application)
INFO  2018-06-24 10:32:31,376 [14   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application) with arguments (Viewtance.GA.Dormitories.Dtos.GetAllBunksInput) - Validation state: Valid
INFO  2018-06-24 10:32:31,470 [14   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application), returned result Microsoft.AspNetCore.Mvc.ObjectResult in 93.4549ms.
INFO  2018-06-24 10:32:31,480 [14   ] .Mvc.Infrastructure.ObjectResultExecutor - Executing ObjectResult, writing value of type 'Abp.Web.Models.AjaxResponse'.
INFO  2018-06-24 10:32:31,480 [14   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application) in 116.1856ms
INFO  2018-06-24 10:32:31,480 [14   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 125.3737ms 200 application/json; charset=utf-8
INFO  2018-06-24 10:32:46,420 [63   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/api/services/ga/Bunk/GetAll?filter=115&numberFilter=&descriptionFilter=&roomNameFilter=&userNameFilter=&stateIdFilter=&maxCheckInTimeFilter=&minCheckInTimeFilter=&maxCheckOutTimeFilter=&minCheckOutTimeFilter=&nameFilter=&sorting=bunkStateName%20asc&skipCount=0&maxResultCount=10 application/json 
INFO  2018-06-24 10:32:46,434 [63   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "ga", action = "GetAll", controller = "Bunk"}. Executing action Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application)
INFO  2018-06-24 10:32:46,447 [63   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application) with arguments (Viewtance.GA.Dormitories.Dtos.GetAllBunksInput) - Validation state: Valid
INFO  2018-06-24 10:32:46,532 [19   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application), returned result Microsoft.AspNetCore.Mvc.ObjectResult in 84.7127ms.
INFO  2018-06-24 10:32:46,541 [19   ] .Mvc.Infrastructure.ObjectResultExecutor - Executing ObjectResult, writing value of type 'Abp.Web.Models.AjaxResponse'.
INFO  2018-06-24 10:32:46,542 [19   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application) in 107.9084ms
INFO  2018-06-24 10:32:46,542 [19   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 121.5354ms 200 application/json; charset=utf-8
DEBUG 2018-06-24 10:36:02,352 [19   ] Viewtance.SRP.Web.Chat.SignalR.ChatHub   - A client is disconnected: eXd406xHH5rdND1JdyuEQA
INFO  2018-06-24 10:36:02,352 [19   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 526880.4817ms 101 
INFO  2018-06-24 10:36:26,913 [19   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/api/services/ga/Bunk/GetAll?filter=115&numberFilter=&descriptionFilter=&roomNameFilter=&userNameFilter=&stateIdFilter=&maxCheckInTimeFilter=&minCheckInTimeFilter=&maxCheckOutTimeFilter=&minCheckOutTimeFilter=&nameFilter=&sorting=bunk.number%20asc&skipCount=0&maxResultCount=10 application/json 
INFO  2018-06-24 10:36:26,941 [63   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "ga", action = "GetAll", controller = "Bunk"}. Executing action Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application)
INFO  2018-06-24 10:36:26,954 [63   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.GA.Dormitories.BunkAppService.GetAll (Viewtance.GA.Application) with arguments (Viewtance.GA.Dormitories.Dtos.GetAllBunksInput) - Validation state: Valid
INFO  2018-06-24 10:36:50,686 [14   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/lib/@aspnet/signalr/dist/browser/signalr.min.js/signalr.min.js.map  
INFO  2018-06-24 10:36:50,694 [14   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 8.0557ms 302 
INFO  2018-06-24 10:36:50,732 [37   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/Error?statusCode=404  
INFO  2018-06-24 10:36:50,741 [37   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Error", area = ""}. Executing action Viewtance.SRP.Web.Controllers.ErrorController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-24 10:36:50,742 [37   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.ErrorController.Index (Viewtance.SRP.Web.Mvc) with arguments (404) - Validation state: Valid
INFO  2018-06-24 10:36:50,743 [37   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.ErrorController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.ViewResult in 0.0196ms.
INFO  2018-06-24 10:36:50,744 [37   ] Core.Mvc.ViewFeatures.ViewResultExecutor - Executing ViewResult, running view Error404.
INFO  2018-06-24 10:38:24,545 [39   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain.com/GA/Dormitory/Rooms  
INFO  2018-06-24 10:38:24,554 [39   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "GA", action = "Rooms", controller = "Dormitory"}. Executing action Viewtance.SRP.Web.Areas.GA.Controllers.DormitoryController.Rooms (Viewtance.SRP.Web.Mvc)
INFO  2018-06-24 10:38:24,555 [39   ] uthorization.DefaultAuthorizationService - Authorization was successful.
INFO  2018-06-24 10:38:24,570 [39   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Areas.GA.Controllers.DormitoryController.Rooms (Viewtance.SRP.Web.Mvc) - Validation state: Valid
INFO  2018-06-24 10:38:24,570 [39   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Areas.GA.Controllers.DormitoryController.Rooms (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.ViewResult in 0.0352ms.
INFO  2018-06-24 10:38:24,585 [19   ] Core.Mvc.ViewFeatures.ViewResultExecutor - Executing ViewResult, running view Rooms.
  • User Avatar
    0
    alper created
    Support Team

    first clear Windows Event Viewer and try to reproduce your issue. It'll show if any unhandled exception throwed. then you can see Chrome Logs to see if the client got some exceptions.

  • User Avatar
    0
    trendline created

    The strange is that no exception system log recorded, the application logs could found the request has been received.

    On the client, the status is no response from the server, no other response.

    If the dotnet process dead or no reponse, then the IIS proxy will throw a message that cannot get response from the upstream server, but in my case it seems upstream dotnet process received the requests, only cannot response result to client.

  • User Avatar
    0
    alper created
    Support Team

    Turn off any anti-virus running on your server or your PC. Actually this has nothing to do with AspNet Zero. You can ask on <a class="postlink" href="https://forums.iis.net/">https://forums.iis.net/</a>

  • User Avatar
    0
    trendline created

    No antivirus or firewall setting block the communication on the server.

    below are the odd behaviors, MVC request no response, see the Account/Login action redirect, but at the same time the API service could get result to client, but not all of the services could get result to client.

    It seems the response blocked after validation the state.

    INFO  2018-06-27 01:22:17,313 [99   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/  
INFO  2018-06-27 01:22:17,320 [99   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Index", controller = "Home", area = ""}. Executing action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-27 01:22:17,322 [99   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) with arguments (, False) - Validation state: Valid
INFO  2018-06-27 01:22:17,322 [99   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.RedirectToActionResult in 0.0264ms.
INFO  2018-06-27 01:22:17,331 [99   ] ft.AspNetCore.Mvc.RedirectToActionResult - Executing RedirectResult, redirecting to /Account/Login.
INFO  2018-06-27 01:22:17,331 [99   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.SRP.Web.Controllers.HomeController.Index (Viewtance.SRP.Web.Mvc) in 10.5059ms
INFO  2018-06-27 01:22:17,331 [99   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 18.2885ms 302 
INFO  2018-06-27 01:22:17,466 [35   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/Account/Login  
INFO  2018-06-27 01:22:17,473 [35   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Login", controller = "Account", area = ""}. Executing action Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc)
INFO  2018-06-27 01:22:17,501 [35   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc) with arguments (, , , ) - Validation state: Valid
INFO  2018-06-27 01:22:17,502 [35   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.ViewResult in 0.2948ms.
INFO  2018-06-27 01:22:17,510 [111  ] Core.Mvc.ViewFeatures.ViewResultExecutor - Executing ViewResult, running view Login.
INFO  2018-06-27 01:28:36,504 [16   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/Account/Login  
INFO  2018-06-27 01:28:36,512 [16   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {action = "Login", controller = "Account", area = ""}. Executing action Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc)
INFO  2018-06-27 01:28:36,540 [16   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc) with arguments (, , , ) - Validation state: Valid
INFO  2018-06-27 01:28:36,540 [16   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.SRP.Web.Controllers.AccountController.Login (Viewtance.SRP.Web.Mvc), returned result Microsoft.AspNetCore.Mvc.ViewResult in 0.3075ms.
INFO  2018-06-27 01:28:36,553 [35   ] Core.Mvc.ViewFeatures.ViewResultExecutor - Executing ViewResult, running view Login.
INFO  2018-06-27 01:29:43,442 [15   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/School/Students  
INFO  2018-06-27 01:29:43,473 [15   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "School", action = "Index", controller = "Students"}. Executing action Viewtance.SRP.Web.Areas.School.Controllers.StudentsController.Index (Viewtance.SRP.Web.Mvc)
INFO  2018-06-27 01:29:43,474 [15   ] uthorization.DefaultAuthorizationService - Authorization was successful.
INFO  2018-06-27 01:29:43,488 [15   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.SRP.Web.Areas.School.Controllers.StudentsController.Index (Viewtance.SRP.Web.Mvc) - Validation state: Valid
INFO  2018-06-27 01:31:58,710 [95   ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/api/services/crm/InfoPath/GetAll?SkipCount=0&MaxResultCount=100 application/json 
INFO  2018-06-27 01:31:58,792 [95   ] uthentication.JwtBearer.JwtBearerHandler - Successfully validated the token.
INFO  2018-06-27 01:31:58,861 [95   ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "crm", action = "GetAll", controller = "InfoPath"}. Executing action Viewtance.CRM.InfoPaths.InfoPathAppService.GetAll (Viewtance.CRM.Application)
INFO  2018-06-27 01:31:59,109 [95   ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.CRM.InfoPaths.InfoPathAppService.GetAll (Viewtance.CRM.Application) with arguments (Viewtance.CRM.InfoPaths.Dtos.GetAllInfoPathsInput) - Validation state: Valid
INFO  2018-06-27 01:31:59,276 [14   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action method Viewtance.CRM.InfoPaths.InfoPathAppService.GetAll (Viewtance.CRM.Application), returned result Microsoft.AspNetCore.Mvc.ObjectResult in 167.0071ms.
INFO  2018-06-27 01:31:59,286 [50   ] .Mvc.Infrastructure.ObjectResultExecutor - Executing ObjectResult, writing value of type 'Abp.Web.Models.AjaxResponse'.
INFO  2018-06-27 01:31:59,298 [50   ] ore.Mvc.Internal.ControllerActionInvoker - Executed action Viewtance.CRM.InfoPaths.InfoPathAppService.GetAll (Viewtance.CRM.Application) in 436.6494ms
INFO  2018-06-27 01:31:59,298 [50   ] soft.AspNetCore.Hosting.Internal.WebHost - Request finished in 588.662ms 200 application/json; charset=utf-8
INFO  2018-06-27 01:32:54,910 [117  ] soft.AspNetCore.Hosting.Internal.WebHost - Request starting HTTP/1.1 GET http://mydomain/api/services/school/Leaves/GetAll application/json 
INFO  2018-06-27 01:32:54,912 [117  ] uthentication.JwtBearer.JwtBearerHandler - Successfully validated the token.
INFO  2018-06-27 01:32:54,918 [117  ] ore.Mvc.Internal.ControllerActionInvoker - Route matched with {area = "school", action = "GetAll", controller = "Leaves"}. Executing action Viewtance.School.Approvals.LeavesAppService.GetAll (Viewtance.School.Application)
INFO  2018-06-27 01:32:54,932 [117  ] ore.Mvc.Internal.ControllerActionInvoker - Executing action method Viewtance.School.Approvals.LeavesAppService.GetAll (Viewtance.School.Application) with arguments (Viewtance.School.Approvals.Dtos.GetAllLeavesInput) - Validation state: Valid
  • User Avatar
    0
    ismcagdas created
    Support Team

    @trendline does this happen only for specific actions or is it random ?

  • User Avatar
    0
    trendline created

    It is a random behavior, without a specified duration or a concurrency request, it also not happened on a specified action, sometimes I am visiting a very simple action it also could lose response then the whole application seems dead.

  • User Avatar
    0
    trendline created

    Does it related to IdentityServer4 settings? IdentityServer4 settings enabled by default, and all the configuration are also default from the template.

  • User Avatar
    0
    ismcagdas created
    Support Team

    @trendline I'm not sure. You can disable it if you are not using it and see if it works.

    This might be related to your database as well. You can check your database logs to see if there are any problems.

  • User Avatar
    0
    trendline created

    I deployed the application to another server with a new database, it happened again, it really is a confused problem, make me crazy.

  • User Avatar
    0
    trendline created

    Anybody who can give me a favor on this issue?

  • User Avatar
    0
    ismcagdas created
    Support Team

    @trendline since there is no pattern for this problem, it is hard to identify it. Have you checked windows logs, IIS logs ? There might be some useful information on those logs.

  • User Avatar
    0
    trendline created

    @ismcagdas

    There are no exception record from windows/IIS logs, they seems works fine.

    The odd behavior is: The lost response happened on tenant site, then the host site works fine.

    On the tenant site the SigalR feature coud works fine during the lost response duration.

    On the client it always waiting from server, if we kill the dotnet.exe process then the client will get cannot retrieve message from upstream server immediately, if we kill the w3p.exe then both dotnet.exe and w3p.exe will restart.

    Furthermore, all of the time, not exception record found in the application logs.

  • User Avatar
    0
    alper created
    Support Team

    you can check the HTTP data traffic with WireShark in server. I guess your request headers are being trimmed. Some routers or firewalls in enterprise networks do that kind of things. Especially when used custom headers, NGINX removes in production (while it allows in development mode)

  • User Avatar
    0
    trendline created

    It should not that case, during the lost response duration, the application logs could record the inbound request, it received the request and route to controller and action, but cannot response to client.

  • User Avatar
    0
    trendline created

    @ismcagdas Could you help me to resolve this issue via TeamViewer when you have time?

  • User Avatar
    0
    alper created
    Support Team

    I am not saying request is completely denied by the routers, it removes some custom headers. If your project works on your development environment and doesn't work on the production this is mostly an environment problem which is kinda out of private support.

  • User Avatar
    0
    trendline created

    @alper, I have changed 2 different servers, they have the same issue in production environment, it maybe related to ABP framework, it only happened in release environment and not always happing.

  • User Avatar
    0
    ismcagdas created
    Support Team

    Hi @trendline,

    Sorry for the late response.

    1. Can we reproduce it if we install it locally on one of our machines ? Event if we don't use it but leave it run for one or two days ?
    2. If so, could you share your project via email including the log files on the server ?

    If not, we can think of something else.

Assignee
No one
Labels
None yet