Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: datacoord compaction trigger may block forever if rootcoord stop first #39856

Closed
1 task done
congqixia opened this issue Feb 13, 2025 · 0 comments
Closed
1 task done

[Bug]: datacoord compaction trigger may block forever if rootcoord stop first #39856

congqixia opened this issue Feb 13, 2025 · 0 comments
Assignees
@congqixia
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.

Comments

@congqixia
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: f391ea1
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

datacoord stop block by compaction trigger since some policy uses context.background and retry forever

Expected Behavior

use lifetime bound context instead of background

Steps To Reproduce



Milvus Log


No response


Anything else?


No response

      		
    

      
  





        



            

              
            

        

      


      
    








      

    



      

  
            

    

      
    

    


      

          @congqixia
congqixia




            added
      

  kind/bug

  Issues or changes related a bug

      

  triage/accepted

  Indicates an issue or PR is ready to be actively worked on.

  labels


      Feb 13, 2025

    

  



    

    

      
    

    


      

          @congqixia
congqixia




              self-assigned this


      Feb 13, 2025

    

  



  


  
    
  
  

    
  congqixia 

      added a commit
        to congqixia/milvus
      that referenced
      this issue

    
      Feb 13, 2025
    
    

      


  

    

      


  

      
        @congqixia
  





      

        
          fix: Add and use lifetime context for compaction trigger
        

          
            
          

      


      

          

    
    
    

  

    


      


      

          

    
    
    

  

  

    
  



      


      
      

        
          4db3d97
        
      

    

  

    

      
Related to milvus-io#39856

This PR add lifetime bound context for compaction trigger and use it
instead of context.Background in case of rootcoord down and some grpc
call retry forever

Signed-off-by: Congqi Xia <[email protected]>

    




    

  




  

  

    
  


  

      

    @congqixia
congqixia



    mentioned this issue
    
      Feb 13, 2025
    





  


  

      
   Merged

  







  




  


  
    
  
  

    
  sre-ci-robot 

      pushed a commit
      that referenced
      this issue

    
      Feb 14, 2025
    
    

      


  

    

      


  

      
        @congqixia
  





      

        
          fix: Add and use lifetime context for compaction trigger (#39857)
        

          
            
          

      


      

          

    
    
    

  

    


      


      

          

    
    
    

  

  

    
  



      


      
      

        
          9bbaaac
        
      

    

  

    

      
Related to #39856

This PR add lifetime bound context for compaction trigger and use it
instead of context.Background in case of rootcoord down and some grpc
call retry forever

---------

Signed-off-by: Congqi Xia <[email protected]>

    




    

  




  


  
    
  
  

    
  congqixia 

      added a commit
        to congqixia/milvus
      that referenced
      this issue

    
      Feb 14, 2025
    
    

      


  

    

      


  

      
        @congqixia
  





      

        
          fix: Add and use lifetime context for compaction trigger (milvus-io#3…
        

          
            
          

      


      

          

    
    
    

  

    


      


      

          

    
    
    

  

  

    
  



      


      
      

        
          f102fa8
        
      

    

  

    

      
…9857)

Related to milvus-io#39856

This PR add lifetime bound context for compaction trigger and use it
instead of context.Background in case of rootcoord down and some grpc
call retry forever

---------

Signed-off-by: Congqi Xia <[email protected]>

    




    

  




  

  

    
  


  

      

    @congqixia
congqixia



    mentioned this issue
    
      Feb 14, 2025
    





  


  

      
   Merged

  







  




  


  
    
  
  

    
  sre-ci-robot 

      pushed a commit
      that referenced
      this issue

    
      Feb 14, 2025
    
    

      


  

    

      


  

      
        @congqixia
  





      

        
          fix: [2.5] Add and use lifetime context for compaction trigger (#39857)…
        

          
            
          

      


      

          

    
    
    

  

    


      


      

          

    
    
    

  

  

    
  



      


      
      

        
          5da9262
        
      

    

  

    

      
… (#39880)

Cherry-pick from master
pr: #39857 
Related to #39856

This PR add lifetime bound context for compaction trigger and use it
instead of context.Background in case of rootcoord down and some grpc
call retry forever

---------

Signed-off-by: Congqi Xia <[email protected]>

    




    

  




    

    











  
  

    

      

  





  




  
  

              

  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment


  



  






  
                    




    

  


      
  

    Assignees
  



        

      

        

  
      @congqixia
  
    congqixia
    

      








      


  


  

    Labels
  



    

      

    kind/bug

  Issues or changes related a bug
  

    triage/accepted

  Indicates an issue or PR is ready to be actively worked on.








      

  

    

        

    Projects
  


        




    None yet




  



      


  

    
  

    Milestone
  


      No milestone





    
      
          


  

    
      

        
    

    Development
  




          
    
No branches or pull requests







    
  




      

    

  
      

  

    

      1 participant
    

    

        
          @congqixia